-- Logs begin at Fri 2022-09-02 20:10:05 UTC, end at Fri 2022-09-02 21:45:12 UTC. -- Sep 02 20:58:17.869895 dv-cinder-852209-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 02 20:58:17.883922 dv-cinder-852209-11-smb devstack@keystone.service[82082]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 20:58:17 2022] *** Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: nodename: dv-cinder-852209-11-smb Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: machine: x86_64 Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: clock source: unix Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: pcre jit disabled Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: detected number of CPU cores: 4 Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: current working directory: / Sep 02 20:58:17.886917 dv-cinder-852209-11-smb devstack@keystone.service[82082]: detected binary path: /usr/bin/uwsgi-core Sep 02 20:58:17.887656 dv-cinder-852209-11-smb devstack@keystone.service[82082]: your processes number limit is 47680 Sep 02 20:58:17.887656 dv-cinder-852209-11-smb devstack@keystone.service[82082]: your memory page size is 4096 bytes Sep 02 20:58:17.887656 dv-cinder-852209-11-smb devstack@keystone.service[82082]: detected max file descriptor number: 2048 Sep 02 20:58:17.887656 dv-cinder-852209-11-smb devstack@keystone.service[82082]: lock engine: pthread robust mutexes Sep 02 20:58:17.887656 dv-cinder-852209-11-smb devstack@keystone.service[82082]: thunder lock: enabled Sep 02 20:58:17.887656 dv-cinder-852209-11-smb devstack@keystone.service[82082]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 02 20:58:17.887656 dv-cinder-852209-11-smb devstack@keystone.service[82082]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 20:58:17.949286 dv-cinder-852209-11-smb devstack@keystone.service[82082]: Python main interpreter initialized at 0x5565175199c0 Sep 02 20:58:17.949286 dv-cinder-852209-11-smb devstack@keystone.service[82082]: python threads support enabled Sep 02 20:58:17.949286 dv-cinder-852209-11-smb devstack@keystone.service[82082]: your server socket listen backlog is limited to 100 connections Sep 02 20:58:17.949286 dv-cinder-852209-11-smb devstack@keystone.service[82082]: your mercy for graceful operations on workers is 90 seconds Sep 02 20:58:17.949835 dv-cinder-852209-11-smb devstack@keystone.service[82082]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 20:58:17.949995 dv-cinder-852209-11-smb devstack@keystone.service[82082]: *** Operational MODE: preforking *** Sep 02 20:58:17.950665 dv-cinder-852209-11-smb devstack@keystone.service[82082]: *** uWSGI is running in multiple interpreter mode *** Sep 02 20:58:17.950665 dv-cinder-852209-11-smb devstack@keystone.service[82082]: spawned uWSGI master process (pid: 82082) Sep 02 20:58:17.950950 dv-cinder-852209-11-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 02 20:58:17.952061 dv-cinder-852209-11-smb devstack@keystone.service[82082]: spawned uWSGI worker 1 (pid: 82093, cores: 1) Sep 02 20:58:17.955493 dv-cinder-852209-11-smb devstack@keystone.service[82082]: spawned uWSGI worker 2 (pid: 82094, cores: 1) Sep 02 20:58:17.955493 dv-cinder-852209-11-smb devstack@keystone.service[82082]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 20:58:22.885026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 20:58:22.885026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: from cryptography.utils import int_from_bytes Sep 02 20:58:22.886262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 20:58:22.886262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: from cryptography.utils import int_from_bytes Sep 02 20:58:22.896714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 20:58:22.896714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: from cryptography.utils import int_from_bytes Sep 02 20:58:22.897573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 20:58:22.897573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: from cryptography.utils import int_from_bytes Sep 02 20:58:22.948794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 20:58:22.949047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 20:58:22.949204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] command line args: [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 20:58:22.949482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 20:58:22.949629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 20:58:22.949775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ================================================================================ {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 20:58:22.949906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] admin_token = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.950044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 20:58:22.950825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] config_dir = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.950977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] command line args: [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 20:58:22.951118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.951263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] config_source = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.951398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 20:58:22.951535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] debug = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.951686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ================================================================================ {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 20:58:22.951825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.952097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] admin_token = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.952211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.952331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.952457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] config_dir = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.952702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.952915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.954757 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] config_source = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.954963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.955112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] debug = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.955282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] list_limit = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.955430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.955606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] log_config_append = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.955606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.955861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.956008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] log_dir = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.956152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.956283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] log_file = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.956414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.956651 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.956835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.957040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.957235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] list_limit = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.957433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.957617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] log_config_append = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.957617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.958008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.958156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] log_dir = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.958156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] log_file = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.958485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.958620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.958760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.958909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.959039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.959170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.959296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.959436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.959436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.959694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.959821 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.960164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.960293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.960474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.960629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.960780 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.960984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.960984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.961351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.961481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.961481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.961869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] publish_errors = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.962989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] publish_errors = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.963127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.963266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.963393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.963520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.963661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.963796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.963925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.964088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.964237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.964375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.964511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] standard_threads = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.964649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] standard_threads = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.964823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.964960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.965197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.965340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.965340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.965583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.965711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] use_journal = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.965879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] use_journal = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] use_json = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] use_json = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] use_stderr = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] use_stderr = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] use_syslog = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] use_syslog = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.966971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 20:58:22.967098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.967224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.967355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.967484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.967625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.967753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.967951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.968344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.968561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.968697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.968877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.969069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.969246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.969494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.969643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.969887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.970040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.970292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.970443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.970704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.970829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.971094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.971233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.971345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.971508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.971639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.971907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.972047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.972220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.972349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.972680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.973114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.973323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.973323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.973905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.974106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.974319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.974516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.974516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.974957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.975184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.975184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.975562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.975762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.975762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.976134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.976326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.976326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.976691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.976922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.976922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.977313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.977517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.977517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.977902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.978045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.978045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.978274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.978398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.978398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.978687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.979038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.979230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.979452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.979452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.979816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.980008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.980008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.980453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.980657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.980931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.981065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.981065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.982020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.982215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.982215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.982612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.983006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.983006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.983440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.983664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.983888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.984102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.984328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.984541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.984541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.985078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.985265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.985414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.985547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.985740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.985873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.986002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.986195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.986375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.986511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.986511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.986807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.986940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.987080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.987226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.987226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.987466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.987650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.987650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.988019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.988218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.988415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.988559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.988559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.988893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.989044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.989044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.989295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.989483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.989667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.989808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.989808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.990997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.991137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.991328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.991328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.991569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.991712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.991841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.991980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.992119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.992246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.992384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.992624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.992779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.992928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.993060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.993203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.993336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.993487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.993638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.993768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.993896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.994026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.994228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.994359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.994504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.994635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.994635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.994869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.995911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.996047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.996188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.996325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.996465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.996592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.996746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.996990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.997947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.998071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.998189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.998415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.998597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.998840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.999027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.999171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.999408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.999559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.999760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:22.999906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.000395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.000547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.000547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.000859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.000993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.001147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.001280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] auth.external = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.001563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.001704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.002130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.002340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.002563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.002705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.002911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] auth.password = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.003060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.003254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] auth.token = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.003391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.003612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.003779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.003966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.004189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.004330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.004612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.004969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.004969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.005216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.005348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.005477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.005716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.005893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.006060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] credential.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.006302 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.006443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.006721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.006875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.007118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.007272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.007497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.007638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.007869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.008009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.008240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.008611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.008815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.009020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.009156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.009307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.009439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.009571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.009779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.009915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.010191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.010334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.010560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.010699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.010945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.011084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.011310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.011448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.011701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.011841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.012056 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.012257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.012409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.012686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.013498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.013643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] auth.external = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.013897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.014060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.014184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.014614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.014912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.015183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.015417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.015417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.015805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] auth.password = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.016006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.016203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] auth.token = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.016340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.016472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.016600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.016600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.016964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.017240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.017440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.017650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.017894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.018092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.018290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.018485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.018485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.018879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.019137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.019334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.019475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.019475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.019864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] credential.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.020079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.020279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.020478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.020478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.020989 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.021200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.021412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.021610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.021610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.021979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.022179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.022393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.022593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.022593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.022964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.023169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.023381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.023593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.023800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.023995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.023995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.024362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.024561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.024561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.024974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.025169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.025363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.025558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.025558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.025938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.026151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.026363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.026561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.026755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.026950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.026950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.027334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.027532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.027726 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.027864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.028053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.028184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.028184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.029575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.029798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.029996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.030220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.030448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.030657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.030856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.031052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.031052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.031422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.031633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.031827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.032023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.032219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.032433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.032433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.032851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.033048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.033242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.033440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.033440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.033804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.034012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.034208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.034404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.034404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.034770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.034962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.035188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.035386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.035386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.035822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.036873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.037148 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.037360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.037557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.037775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.037775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.038145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.038354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.038552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.038753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.038948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.039143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.039427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.039662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.039662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.040034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.040248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.040444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.040640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.040640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.041130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.041322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.041516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.041713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.041961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.042158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.042158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.042487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.042682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.042682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.043087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.043285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.043483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.043675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.043871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.044034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.044164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.044282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.044398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.044677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.044677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.045172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.045386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.045596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.045792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.045792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.046163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.046361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.046571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.046765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.046958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.047153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.047345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.047540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.047745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.047942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.047942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.048322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.048517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.048711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.049023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.049023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.049422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.049623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.049816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.050011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.050223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.050419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.050629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.050825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.050825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.051203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.051416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.051554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.051808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] role.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.052003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.052199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] role.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.052199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.052947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.053146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.053342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.053538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.053538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.053908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.054133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.054133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.054515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.054711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.054845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.055056 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.055263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.055461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.055461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.055838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.056033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.056229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.056440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.056440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.056865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.057062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.057275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.057471 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.057677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.057875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.058067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.058263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.058459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.058811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.058811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.059181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.059374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.059512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.059659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.059659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.059884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.060145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.060282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.060399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.060666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.060909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.060909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.061282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.061476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.061673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.061885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.062096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.062295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.062295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.062659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.062855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.063048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.063259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.063457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.063653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.063851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.064046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.064239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.064447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.064657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.064875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.064875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.065242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.065434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.065649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.065844 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.066040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.066235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.066235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.066600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.066807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.067004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.067198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.067198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.067582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.067777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.067988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.068180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.068377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.068568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.068568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.069038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.069251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.069460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.069672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.069672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.070056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.070263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.connection = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.070504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.070711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.070849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.070966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.070966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.071413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.071604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.071815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.072010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.072010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.072376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.072572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.072807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.073021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.073021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.073406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.073603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.073796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.073989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.073989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.074374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.074569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.074764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.074959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.075681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.075890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.075890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.076281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.076477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.076676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.076926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.076926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] role.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.077312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] role.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.078918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.078918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.078918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.078918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.078918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.079806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.079806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.080137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.080496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.080892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.081273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.081669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.082053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.082427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.082990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.083354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.083730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.084109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.084482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.084913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.085284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.085665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.086041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.086442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.086848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.087224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.087580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.087957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.088337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.088709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.089098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.089466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.089823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.090186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.090548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.091579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.091917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.092282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.092630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.093015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.093416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.093756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.094104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.094491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.094829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.095161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.095531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.095902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.096230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.096581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.096984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.097353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.connection = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.097694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.098037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.098371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.098706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.099037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.099377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.099709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.100043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.100385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.100719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.101157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.101535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.101857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.102164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.102490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.102788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.103096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.103406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 20:58:23.103638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 20:58:23.111524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.111867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.112177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.121821 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.133081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.133385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.133618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.143053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.154031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.154374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.163234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.163481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.214425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.214722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.280996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.280996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.281356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.281356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.469746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.469992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.470200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.470481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.470725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.470927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.504078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.504330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.504517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.504768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.505114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.505337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.505578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.518141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.521032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.521437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.521843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.522292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.522624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.523017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.532434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.532633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.532861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.533127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.533406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.533635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.533850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82093) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.548242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.548646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.549081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.549491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.549898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.550277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.550676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.564791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.565090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 20:58:23.565332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.565536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 20:58:23.565816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.566082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.566347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.566612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.567166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.572854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.573259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.573655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.574050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.574444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.574844 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.583314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 20:58:23.583505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.583505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.583505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.583505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.589156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.595075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.595581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.596064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.596560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.597079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.597542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.597999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.598413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.598863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.599348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.599813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.601597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.601970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 20:58:23.602648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.602943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 20:58:23.603427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.603886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.604357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.604864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.617547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.617858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.618132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.618430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.627146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.630219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.630578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.630945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.631238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.631519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.631784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.632059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.632339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.632617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.633006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.633390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.646265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.648967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.649441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.658414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.658893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.659183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.659421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.661071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.661447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.667253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.667700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.667994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.672568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.673105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.675948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.676322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.680681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.681029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.681332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.683362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.683793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.683949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.684238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.684528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.685336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.685846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.685996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.686268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.686699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.687159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.687607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.688138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.705444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.705846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.712614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.714013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.714426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.717767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.718246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.719950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.723385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.725521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.725521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.728516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.730169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.732886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.733317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.743698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.743698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.743698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.743698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.744385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.744385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.744385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.744385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.744385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.744385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.745784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.754512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.754927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.755316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.755652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.763520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.763979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.764378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.764777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.765123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.766135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.769129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.769593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.772752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.773189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.773650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.774133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.774631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.774861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.776563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.779305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.779305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.782300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.786307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.786307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.786307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.786307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.789971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.790455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.790828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.791202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.791684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.792117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.792532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.797539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.798059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.798457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.798932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.799594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.800088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.800548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.812437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.816710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.819956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.820975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.822978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.823645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.829612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.829612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.829612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.830067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.830067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.833729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.834211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.834860 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.835709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.837707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.841464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.842002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.842498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.842897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.843109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.844592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.849803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.850477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.850938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.851352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.851569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.851822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.853966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.860599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.861011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.861366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.861790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.870159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.870159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.870159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.870159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.870159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.870159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.876224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.876224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.876224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.876224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.876796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.876796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.876796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.881326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82093) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 20:58:23.881646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.882112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.882575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.883055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.883533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.884006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.884485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.884991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.885501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.886365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.886561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.886981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.887487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82093) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 20:58:23.911962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565175199c0 pid: 82094 (default app) Sep 02 20:58:23.916665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b62b-a22e-428a-aaa3-ec8051cddeff None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:23.917131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b62b-a22e-428a-aaa3-ec8051cddeff None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:23.917385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b62b-a22e-428a-aaa3-ec8051cddeff None None] PATH_INFO: `/v3` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:23.924537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Fri Sep 2 20:58:23 2022] GET /identity/v3/ => generated 255 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:58:23.939589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565175199c0 pid: 82093 (default app) Sep 02 20:58:33.964846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e661d-dd7e-4512-af6d-33d17dac35b4 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:33.965376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e661d-dd7e-4512-af6d-33d17dac35b4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:33.965376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e661d-dd7e-4512-af6d-33d17dac35b4 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:33.966766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:58:33.980389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:33.980389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:33.980389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:34.060053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: INFO dbcounter [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] Registered counter for database keystone Sep 02 20:58:34.092004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG oslo_db.sqlalchemy.engines [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 20:58:34.099904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writer thread running {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 20:58:34.306949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG passlib.handlers.bcrypt [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82093) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 20:58:34.307279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG passlib.handlers.bcrypt [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82093) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 20:58:34.370300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:34.372670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:34.564488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1/3] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 592 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 02 20:58:35.268095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e661d-dd7e-4512-af6d-33d17dac35b4 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:35.344534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: INFO dbcounter [None req-025e661d-dd7e-4512-af6d-33d17dac35b4 None None] Registered counter for database keystone Sep 02 20:58:35.368120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG oslo_db.sqlalchemy.engines [None req-025e661d-dd7e-4512-af6d-33d17dac35b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 20:58:35.377320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writer thread running {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 20:58:35.518885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e661d-dd7e-4512-af6d-33d17dac35b4 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:35.523825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61467072-f1ef-4cee-9679-7bd0d5516d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:35.524467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467072-f1ef-4cee-9679-7bd0d5516d16 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:35.524774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467072-f1ef-4cee-9679-7bd0d5516d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:35.525156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467072-f1ef-4cee-9679-7bd0d5516d16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:35.537195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61467072-f1ef-4cee-9679-7bd0d5516d16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:35.595133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING keystone.common.rbac_enforcer.enforcer [None req-61467072-f1ef-4cee-9679-7bd0d5516d16 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 20:58:35.595475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61467072-f1ef-4cee-9679-7bd0d5516d16 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:35.607593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 3/4] 10.222.0.71 () {58 vars in 1324 bytes} [Fri Sep 2 20:58:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 20:58:35.614067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:35.631497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ff4dc-ad75-47ea-b09b-6962914377b4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:35.636452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be77ddc-0fe5-4d38-98e1-eae1ed26fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:35.638990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be77ddc-0fe5-4d38-98e1-eae1ed26fa60 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:35.639367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be77ddc-0fe5-4d38-98e1-eae1ed26fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:35.639666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be77ddc-0fe5-4d38-98e1-eae1ed26fa60 admin admin] PATH_INFO: `/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:35.641387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be77ddc-0fe5-4d38-98e1-eae1ed26fa60 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed07aa8a11c5411cab1c62d6e9841ea5)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:35.699621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4be77ddc-0fe5-4d38-98e1-eae1ed26fa60 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 20:58:35.700638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be77ddc-0fe5-4d38-98e1-eae1ed26fa60 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:35.705920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 2/5] 10.222.0.71 () {56 vars in 1207 bytes} [Fri Sep 2 20:58:35 2022] GET /identity/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:38.794973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c54b-7048-421c-9df7-5d2db13a9a8f None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:38.795837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c54b-7048-421c-9df7-5d2db13a9a8f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:38.795976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c54b-7048-421c-9df7-5d2db13a9a8f None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:38.804467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 4/6] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:38 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:38.814219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b7b32-d5a2-4d86-bfe6-ae09fb5e7583 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:38.814993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b7b32-d5a2-4d86-bfe6-ae09fb5e7583 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:38.814993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b7b32-d5a2-4d86-bfe6-ae09fb5e7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:38.845086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2d3b7b32-d5a2-4d86-bfe6-ae09fb5e7583 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:38.846815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2d3b7b32-d5a2-4d86-bfe6-ae09fb5e7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:38.859404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 3/7] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 02 20:58:39.157557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866c54b-7048-421c-9df7-5d2db13a9a8f None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:39.179812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866c54b-7048-421c-9df7-5d2db13a9a8f None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:39.187788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade074b-e6ff-487e-8019-839d923ae46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:39.188831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade074b-e6ff-487e-8019-839d923ae46e admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:39.189340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade074b-e6ff-487e-8019-839d923ae46e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:39.189839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade074b-e6ff-487e-8019-839d923ae46e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:39.205881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade074b-e6ff-487e-8019-839d923ae46e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:39.209495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade074b-e6ff-487e-8019-839d923ae46e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:39.227098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 5/8] 10.222.0.71 () {58 vars in 1324 bytes} [Fri Sep 2 20:58:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 20:58:39.236050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b7b32-d5a2-4d86-bfe6-ae09fb5e7583 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:39.252994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b7b32-d5a2-4d86-bfe6-ae09fb5e7583 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:39.260613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4481797-77e4-439e-953e-e178a99808cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:39.261713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481797-77e4-439e-953e-e178a99808cf admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:39.262080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481797-77e4-439e-953e-e178a99808cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:39.262971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481797-77e4-439e-953e-e178a99808cf admin admin] PATH_INFO: `/v3/users/b18239f8e6e4489d8c11b7502bca0733` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:39.264858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4481797-77e4-439e-953e-e178a99808cf admin admin] RBAC: Authorizing `identity:get_user(user_id=b18239f8e6e4489d8c11b7502bca0733)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:39.266766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4481797-77e4-439e-953e-e178a99808cf admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:39.268435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 4/9] 10.222.0.71 () {56 vars in 1198 bytes} [Fri Sep 2 20:58:39 2022] GET /identity/v3/users/b18239f8e6e4489d8c11b7502bca0733 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:41.529608 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a56fc-1a67-4b4f-a6ff-7c5733ab08c5 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:41.530425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a56fc-1a67-4b4f-a6ff-7c5733ab08c5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:41.530425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a56fc-1a67-4b4f-a6ff-7c5733ab08c5 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:41.531501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:41.538332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07023b92-a311-46f3-88b0-fec448ac7291 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:41.539304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07023b92-a311-46f3-88b0-fec448ac7291 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:41.539304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07023b92-a311-46f3-88b0-fec448ac7291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:41.566473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-07023b92-a311-46f3-88b0-fec448ac7291 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:41.568371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-07023b92-a311-46f3-88b0-fec448ac7291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:41.693779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 5/11] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:41.775087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ec8b-3c95-4b04-9416-121cfca484b3 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:41.775370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ec8b-3c95-4b04-9416-121cfca484b3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:41.775636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ec8b-3c95-4b04-9416-121cfca484b3 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:41.777051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 7/12] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:41.783875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c294c9-5faa-43a0-9748-89cf6896b6cc None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:41.784259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c294c9-5faa-43a0-9748-89cf6896b6cc None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:41.784603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c294c9-5faa-43a0-9748-89cf6896b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:41.814408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e0c294c9-5faa-43a0-9748-89cf6896b6cc None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:41.815647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e0c294c9-5faa-43a0-9748-89cf6896b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:41.844768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:41.927833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 6/13] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:41.980045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ec8b-3c95-4b04-9416-121cfca484b3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:42.177166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ec8b-3c95-4b04-9416-121cfca484b3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:42.222951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:42.224322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:42.224604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:42.224958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:42.238564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:58:42.248710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:58:42.249773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:58:42.250537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 8/14] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:58:42.257722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c294c9-5faa-43a0-9748-89cf6896b6cc None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:42.289001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:42.351234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:42.439486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c294c9-5faa-43a0-9748-89cf6896b6cc None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:42.474702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea53e79-f824-43d1-903f-1ed0b0907871 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:42.488986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:42.489638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:42.489921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:42.490195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:42.491181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:58:42.491671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:42.493951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:42.508466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 7/15] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:42.515839 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:42.540100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:42.544682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:42.545915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:42.545915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:42.545915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:42.665442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:42.667184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:42.686208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f386-1c46-4953-999e-3186e90ea25d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:42.717899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:42.743119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:42.744223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:42.744724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:42.745280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] PATH_INFO: `/v3/users/b18239f8e6e4489d8c11b7502bca0733` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:42.748500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] RBAC: Authorizing `identity:get_user(user_id=b18239f8e6e4489d8c11b7502bca0733)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:42.751260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:42.763081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 8/16] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:58:42 2022] GET /identity/v3/users/b18239f8e6e4489d8c11b7502bca0733 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:42.765708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:42.837703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 9/17] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:58:42.847598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:42.927216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:42.962909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5887a-6e0b-40b9-888c-df14fcc71b9a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:43.010941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:43.011616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:43.011892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:43.012522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:43.013804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:43.015314 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:43.016992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:43.025488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:43.046258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff95cc-1c7e-4e5b-b337-f66fd829cd99 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:43.095696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:43.096354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:43.096633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:43.096972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:43.099500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:43.124392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:43.125978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 20:58:43.145195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:58:43.146382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 20:58:43.147173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 20:58:43.147173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 20:58:43.147173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:58:43.147173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 20:58:43.152491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:43.163182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3145dfb-c974-4a42-acd1-afa15fd8b69f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:43.213416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ca9f-31a4-4115-a398-6a98ea0f8288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:43.214049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ca9f-31a4-4115-a398-6a98ea0f8288 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:43.214324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ca9f-31a4-4115-a398-6a98ea0f8288 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:43.214595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ca9f-31a4-4115-a398-6a98ea0f8288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:43.215378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670ca9f-31a4-4115-a398-6a98ea0f8288 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.domain.id=default, user.id=b18239f8e6e4489d8c11b7502bca0733) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:58:43.215687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670ca9f-31a4-4115-a398-6a98ea0f8288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:43.217224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670ca9f-31a4-4115-a398-6a98ea0f8288 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:43.225001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 10/20] 10.222.0.71 () {56 vars in 1322 bytes} [Fri Sep 2 20:58:43 2022] GET /identity/v3/role_assignments?user.id=b18239f8e6e4489d8c11b7502bca0733&scope.domain.id=default&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 233 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:43.297373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd6ba3-6faa-4194-b282-1731c9cb3d26 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:43.347230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e92c5-f304-4942-bd28-87ab299ab2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:43.348250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e92c5-f304-4942-bd28-87ab299ab2fd None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:43.348537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e92c5-f304-4942-bd28-87ab299ab2fd None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:43.348846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e92c5-f304-4942-bd28-87ab299ab2fd None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:43.349530 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e92c5-f304-4942-bd28-87ab299ab2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:58:43.349839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e92c5-f304-4942-bd28-87ab299ab2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:43.351594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e92c5-f304-4942-bd28-87ab299ab2fd None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:43.378034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 11/21] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 20:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:46.517568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54da5-2e8b-4374-bd07-30967ffe653c None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:46.518343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54da5-2e8b-4374-bd07-30967ffe653c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:46.518463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54da5-2e8b-4374-bd07-30967ffe653c None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:46.521703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 11/22] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:46.530387 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:46.531719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:46.532417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:46.573122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG passlib.handlers.bcrypt [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82094) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 20:58:46.574127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG passlib.handlers.bcrypt [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82094) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 20:58:46.638043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:46.640104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:46.701951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e085c72-c191-48d0-aa3d-054e2e97cf8f None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:46.702436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e085c72-c191-48d0-aa3d-054e2e97cf8f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:46.703375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e085c72-c191-48d0-aa3d-054e2e97cf8f None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:46.706756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 12/23] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:46.713952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f1c8-543a-440a-81b1-8e43191bf4df None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:46.714746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f1c8-543a-440a-81b1-8e43191bf4df None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:46.716721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07f1c8-543a-440a-81b1-8e43191bf4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:46.774510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0f07f1c8-543a-440a-81b1-8e43191bf4df None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:46.780490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0f07f1c8-543a-440a-81b1-8e43191bf4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:46.785346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:46.817289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:46.860771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 12/24] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:46.988440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 13/25] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:47.459552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:47.591986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1b7d-2ba1-43ac-978c-f5e36a49f9ba None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:47.592617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1b7d-2ba1-43ac-978c-f5e36a49f9ba None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:47.593024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1b7d-2ba1-43ac-978c-f5e36a49f9ba None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:47.595689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 14/26] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:58:47.602302 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5a76-1b8d-49a2-8d41-f80444997d0a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:47.603028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5a76-1b8d-49a2-8d41-f80444997d0a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:47.603636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5a76-1b8d-49a2-8d41-f80444997d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:47.658397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a7ec5a76-1b8d-49a2-8d41-f80444997d0a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:47.660566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a7ec5a76-1b8d-49a2-8d41-f80444997d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:47.690798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502664a-0e78-4b55-9f27-7c5fce45c493 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:47.781625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b7350-f87b-4794-91cc-9cf2dfe99b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:47.782977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b7350-f87b-4794-91cc-9cf2dfe99b6e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:47.783449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b7350-f87b-4794-91cc-9cf2dfe99b6e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:47.784047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b7350-f87b-4794-91cc-9cf2dfe99b6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:47.799910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b7350-f87b-4794-91cc-9cf2dfe99b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-4d3b7350-f87b-4794-91cc-9cf2dfe99b6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:58:47.808675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:58:47.810244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:58:47.811068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:58:47.814157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 13/27] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:58:47.815905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507357-0c89-4146-910a-e78adf3e6843 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:47.816361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507357-0c89-4146-910a-e78adf3e6843 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:47.816817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507357-0c89-4146-910a-e78adf3e6843 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:47.818747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 14/28] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:47.824836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84507357-0c89-4146-910a-e78adf3e6843 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:47.870507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 15/29] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:47.876852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec5a76-1b8d-49a2-8d41-f80444997d0a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:47.925242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:48.122360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:48.139829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84507357-0c89-4146-910a-e78adf3e6843 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:48.202584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec5a76-1b8d-49a2-8d41-f80444997d0a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:48.257244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aed4fb-6115-49b3-8f27-0a3236704134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:48.258356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aed4fb-6115-49b3-8f27-0a3236704134 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:48.258849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aed4fb-6115-49b3-8f27-0a3236704134 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:48.259337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aed4fb-6115-49b3-8f27-0a3236704134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:48.295573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aed4fb-6115-49b3-8f27-0a3236704134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:48.298978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aed4fb-6115-49b3-8f27-0a3236704134 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:48.341752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:48.342763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:48.343240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:48.343724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:48.345001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:58:48.345562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:48.350891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-15aed4fb-6115-49b3-8f27-0a3236704134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 20:58:48.354237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:58:48.355112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 20:58:48.357195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 20:58:48.357195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 20:58:48.357195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:58:48.357497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 15/30] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 538 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:58:48.360590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f439-a684-4ff7-9596-500f5b662af5 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:48.361114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f439-a684-4ff7-9596-500f5b662af5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:48.361600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f439-a684-4ff7-9596-500f5b662af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:48.364722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 16/31] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:58:48.365976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:48.415762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-aa79f439-a684-4ff7-9596-500f5b662af5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:48.419654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-aa79f439-a684-4ff7-9596-500f5b662af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:48.528000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 16/32] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:48.531552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79f439-a684-4ff7-9596-500f5b662af5 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:48.568205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5fe7f-f767-4e1f-b9c0-bfdb0431c799 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:48.608575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:48.625771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389a3e-bfa8-48dc-b530-8d8fcf7502a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:48.630492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389a3e-bfa8-48dc-b530-8d8fcf7502a2 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:48.630492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389a3e-bfa8-48dc-b530-8d8fcf7502a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:48.630492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389a3e-bfa8-48dc-b530-8d8fcf7502a2 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:48.630492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389a3e-bfa8-48dc-b530-8d8fcf7502a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:48.631256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389a3e-bfa8-48dc-b530-8d8fcf7502a2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:48.640766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:48.791674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79f439-a684-4ff7-9596-500f5b662af5 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:48.841402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:48.842123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:48.842399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:48.842666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:48.843343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:58:48.843643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:48.845507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:48.860595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 17/33] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 20:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:58:48.861856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:48.981445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:49.035940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6980ccd-0499-4956-ad2e-681fa791c339 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:49.060312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 17/34] 10.222.0.71 () {60 vars in 1131 bytes} [Fri Sep 2 20:58:48 2022] POST /identity/v3/roles => generated 219 bytes in 695 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:58:49.063404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378914-e271-4df5-803a-36811abdedb0 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:49.063881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378914-e271-4df5-803a-36811abdedb0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:49.064383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378914-e271-4df5-803a-36811abdedb0 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:49.067045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 18/35] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:49.069245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c978-5126-41d2-bc4e-6ba1bb6e3ee4 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:49.069754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c978-5126-41d2-bc4e-6ba1bb6e3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:49.070284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c978-5126-41d2-bc4e-6ba1bb6e3ee4 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:49.072966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 19/36] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:49.077806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c978-5126-41d2-bc4e-6ba1bb6e3ee4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:49.118701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:49.119587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:49.120003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:49.120423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] PATH_INFO: `/v3/users/b18239f8e6e4489d8c11b7502bca0733` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:49.122598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] RBAC: Authorizing `identity:get_user(user_id=b18239f8e6e4489d8c11b7502bca0733)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:49.124886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:49.127119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 18/37] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:58:48 2022] GET /identity/v3/users/b18239f8e6e4489d8c11b7502bca0733 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:58:49.128861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:49.314358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c978-5126-41d2-bc4e-6ba1bb6e3ee4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:49.338919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c525397-56f0-4528-9d9d-b52353b3006d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:49.395115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786af65-5898-4b17-a0bc-1358717a8f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:49.396495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786af65-5898-4b17-a0bc-1358717a8f7d None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:49.396882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786af65-5898-4b17-a0bc-1358717a8f7d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:49.397402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786af65-5898-4b17-a0bc-1358717a8f7d None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:49.398911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786af65-5898-4b17-a0bc-1358717a8f7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:49.401584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786af65-5898-4b17-a0bc-1358717a8f7d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:49.422445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b74e-21ac-4976-a8d7-8e637ade7a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:49.423083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b74e-21ac-4976-a8d7-8e637ade7a0c None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:49.423403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b74e-21ac-4976-a8d7-8e637ade7a0c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:49.423701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b74e-21ac-4976-a8d7-8e637ade7a0c None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:49.424411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b74e-21ac-4976-a8d7-8e637ade7a0c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:49.425910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b74e-21ac-4976-a8d7-8e637ade7a0c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:49.640881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 20/38] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 20:58:49 2022] POST /identity/v3/projects => generated 301 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:58:49.640881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e931db-e299-451e-bc7d-ffa910647626 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:49.640881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e931db-e299-451e-bc7d-ffa910647626 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:49.640881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e931db-e299-451e-bc7d-ffa910647626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:49.657919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 19/39] 10.222.0.71 () {60 vars in 1131 bytes} [Fri Sep 2 20:58:49 2022] POST /identity/v3/roles => generated 225 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:58:49.669359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34193-22b1-4ab5-917b-ff6f79f909c7 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:49.669359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34193-22b1-4ab5-917b-ff6f79f909c7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:49.669359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34193-22b1-4ab5-917b-ff6f79f909c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:49.669644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-15e931db-e299-451e-bc7d-ffa910647626 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:49.669644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-15e931db-e299-451e-bc7d-ffa910647626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:49.692210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:49.694380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1fd34193-22b1-4ab5-917b-ff6f79f909c7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:49.703311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1fd34193-22b1-4ab5-917b-ff6f79f909c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:49.762717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:49.816182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 21/40] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:49.817325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e931db-e299-451e-bc7d-ffa910647626 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:49.846918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 20/41] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:50.060107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e931db-e299-451e-bc7d-ffa910647626 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:50.142672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:50.143335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:50.143614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:50.143891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:50.145235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:50.146835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:50.148968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 22/42] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:58:50.155897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd34193-22b1-4ab5-917b-ff6f79f909c7 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:50.165425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:50.248846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:50.363564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd34193-22b1-4ab5-917b-ff6f79f909c7 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:50.375652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e993b-5a56-432e-83f3-393ba3f10d73 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:50.440042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:50.441281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:50.441762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:50.442244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] PATH_INFO: `/v3/domains/default/users/b18239f8e6e4489d8c11b7502bca0733/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:50.448113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:50.449093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:50.449978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:50.450255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b18239f8e6e4489d8c11b7502bca0733, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:50.450405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:50.451548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:50.454521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:50.454736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:50.463611 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:50.615303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 23/43] 10.222.0.71 () {60 vars in 1131 bytes} [Fri Sep 2 20:58:50 2022] POST /identity/v3/roles => generated 223 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 20:58:50.616848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:50.655895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 21/44] 10.222.0.71 () {58 vars in 1361 bytes} [Fri Sep 2 20:58:50 2022] PUT /identity/v3/domains/default/users/b18239f8e6e4489d8c11b7502bca0733/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:58:50.843145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da93b-4687-4482-80ac-36a3d014c61a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:50.852563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:50.910237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242560b5-858d-4f26-82f5-f32ec9b68908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:50.911041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242560b5-858d-4f26-82f5-f32ec9b68908 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:50.911333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242560b5-858d-4f26-82f5-f32ec9b68908 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:50.911692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242560b5-858d-4f26-82f5-f32ec9b68908 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:50.913339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242560b5-858d-4f26-82f5-f32ec9b68908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:50.918584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242560b5-858d-4f26-82f5-f32ec9b68908 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:50.919287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 24/45] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:58:50.927531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:51.113226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0ecf8-6740-4c15-9d34-88f85fc5670f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:51.174831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a91f9-ce67-422c-b1cc-067fb67ccb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:51.175385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a91f9-ce67-422c-b1cc-067fb67ccb54 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:51.175750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a91f9-ce67-422c-b1cc-067fb67ccb54 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:51.176115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a91f9-ce67-422c-b1cc-067fb67ccb54 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:51.176953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a91f9-ce67-422c-b1cc-067fb67ccb54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:51.178444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a91f9-ce67-422c-b1cc-067fb67ccb54 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:51.306961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 22/46] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 20:58:50 2022] POST /identity/v3/projects => generated 312 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 20:58:53.225509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530bb8-9cec-4995-b058-2b637a6d2b3b None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:53.226379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530bb8-9cec-4995-b058-2b637a6d2b3b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:53.226379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530bb8-9cec-4995-b058-2b637a6d2b3b None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:53.228089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 25/47] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:53.236595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65ca5-6630-4cba-bcc2-ee3a5180d475 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:53.237252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65ca5-6630-4cba-bcc2-ee3a5180d475 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:53.237252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65ca5-6630-4cba-bcc2-ee3a5180d475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:53.373561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c5f65ca5-6630-4cba-bcc2-ee3a5180d475 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:53.375166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c5f65ca5-6630-4cba-bcc2-ee3a5180d475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:53.438687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:53.486110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 23/48] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:53.961674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7530bb8-9cec-4995-b058-2b637a6d2b3b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:54.289955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7936aec-1d27-4787-a571-ce35f60c13cf None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:54.289955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7936aec-1d27-4787-a571-ce35f60c13cf None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:54.289955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7936aec-1d27-4787-a571-ce35f60c13cf None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:54.292209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 24/49] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:54.302266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c076-a7e0-40c9-ad52-45a3f80427d4 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:54.302780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c076-a7e0-40c9-ad52-45a3f80427d4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:54.303280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c076-a7e0-40c9-ad52-45a3f80427d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:54.325606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7530bb8-9cec-4995-b058-2b637a6d2b3b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:54.344865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1974c076-a7e0-40c9-ad52-45a3f80427d4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:54.347301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1974c076-a7e0-40c9-ad52-45a3f80427d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:54.402208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:54.402862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:54.403290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:54.403678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:54.433407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:58:54.453129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:58:54.455029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:58:54.456892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 26/50] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 20:58:54.465471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:54.501199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 25/51] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:58:54.540227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:54.687934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375889-be6c-4b19-9425-661c09e4df3c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:54.777397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:54.779113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:54.779639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:54.780117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:54.781502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:58:54.782064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:54.784761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:54.802452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 27/52] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:54.812447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c076-a7e0-40c9-ad52-45a3f80427d4 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:54.862665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:55.011430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c076-a7e0-40c9-ad52-45a3f80427d4 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:55.027635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:55.029061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:55.037028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94162a4-1812-4f07-9ad7-6c2b6b06fac6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:55.075340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:55.076192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:55.076635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:55.077106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] PATH_INFO: `/v3/users/b18239f8e6e4489d8c11b7502bca0733` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:55.079090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] RBAC: Authorizing `identity:get_user(user_id=b18239f8e6e4489d8c11b7502bca0733)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:55.081509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:55.084149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:58:54 2022] GET /identity/v3/users/b18239f8e6e4489d8c11b7502bca0733 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:55.093078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:55.096419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:55.097667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:55.098128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:55.098594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:55.101217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:55.102653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:55.107617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 28/54] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:55.120923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:55.314069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350cf54-44b0-4315-a9d2-2961d628e916 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:55.330775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941571c2-dba8-4ecb-b842-a4573e1457d0 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:55.388537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:55.389952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:55.390444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:55.391161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:55.393224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:55.396063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:55.407894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:55.408119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569dc55-6102-48a6-890e-b4ecef5e843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:55.408119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569dc55-6102-48a6-890e-b4ecef5e843d None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:55.408119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569dc55-6102-48a6-890e-b4ecef5e843d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:55.408119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569dc55-6102-48a6-890e-b4ecef5e843d None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:55.408395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569dc55-6102-48a6-890e-b4ecef5e843d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:55.408395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569dc55-6102-48a6-890e-b4ecef5e843d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:55.409935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:55.505660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:55.564803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 29/56] 10.222.0.71 () {60 vars in 1140 bytes} [Fri Sep 2 20:58:55 2022] POST /identity/v3/projects => generated 298 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 20:58:55.622902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6750cb6-e6bf-40ef-ad6b-88c7c451d90e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:55.704489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88773fa-fac9-4c15-b222-50470932c8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:55.705604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88773fa-fac9-4c15-b222-50470932c8fd None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:55.706372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88773fa-fac9-4c15-b222-50470932c8fd None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:55.707122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88773fa-fac9-4c15-b222-50470932c8fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:55.707928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88773fa-fac9-4c15-b222-50470932c8fd None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.domain.id=default, user.id=b18239f8e6e4489d8c11b7502bca0733) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:58:55.708705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88773fa-fac9-4c15-b222-50470932c8fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:55.711383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88773fa-fac9-4c15-b222-50470932c8fd None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:55.728108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1322 bytes} [Fri Sep 2 20:58:55 2022] GET /identity/v3/role_assignments?user.id=b18239f8e6e4489d8c11b7502bca0733&scope.domain.id=default&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 530 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:58:58.262756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0183a-2dea-4f84-9050-fcdd85c5f363 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:58.263328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0183a-2dea-4f84-9050-fcdd85c5f363 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:58.263328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0183a-2dea-4f84-9050-fcdd85c5f363 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:58.265948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 30/58] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:58:58.273136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63c9a2-7661-4369-880a-823351322c27 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:58.273715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63c9a2-7661-4369-880a-823351322c27 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:58.274104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63c9a2-7661-4369-880a-823351322c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:58.306081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ee63c9a2-7661-4369-880a-823351322c27 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:58:58.308399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ee63c9a2-7661-4369-880a-823351322c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:58:58.455512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 29/59] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:58:58.889657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0183a-2dea-4f84-9050-fcdd85c5f363 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:58.921592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:59.054522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0183a-2dea-4f84-9050-fcdd85c5f363 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:59.102065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fe32d-08f9-4d61-a959-2ee3b67d91a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:59.102756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe32d-08f9-4d61-a959-2ee3b67d91a7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:59.104456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe32d-08f9-4d61-a959-2ee3b67d91a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:59.104456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe32d-08f9-4d61-a959-2ee3b67d91a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:59.104808 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fe32d-08f9-4d61-a959-2ee3b67d91a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:59.106953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fe32d-08f9-4d61-a959-2ee3b67d91a7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:59.108807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 31/60] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:58:59.118204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63c9a2-7661-4369-880a-823351322c27 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:58:59.178753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:58:59.298768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63c9a2-7661-4369-880a-823351322c27 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:58:59.368213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c3063-2a28-4aa0-97d7-fa286dd39aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:58:59.369143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c3063-2a28-4aa0-97d7-fa286dd39aae None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:58:59.369628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c3063-2a28-4aa0-97d7-fa286dd39aae None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:58:59.370116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c3063-2a28-4aa0-97d7-fa286dd39aae None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:58:59.371992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c3063-2a28-4aa0-97d7-fa286dd39aae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:58:59.374794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c3063-2a28-4aa0-97d7-fa286dd39aae None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:58:59.556348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 30/61] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 20:58:59 2022] POST /identity/v3/users => generated 275 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:59:04.581406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9b934-aed0-4027-9a2e-37bb0c61e5c8 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:04.582850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9b934-aed0-4027-9a2e-37bb0c61e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:04.583583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9b934-aed0-4027-9a2e-37bb0c61e5c8 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:04.586171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 32/62] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:04.595903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632acad-913b-40dd-92da-8dbd141091d9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:04.597434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632acad-913b-40dd-92da-8dbd141091d9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:04.598163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632acad-913b-40dd-92da-8dbd141091d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:04.634170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8632acad-913b-40dd-92da-8dbd141091d9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:04.636158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8632acad-913b-40dd-92da-8dbd141091d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:04.685975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974db40-9c3c-4524-b11c-5da325dd7bd1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:04.686775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974db40-9c3c-4524-b11c-5da325dd7bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:04.687255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974db40-9c3c-4524-b11c-5da325dd7bd1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:04.689088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 33/63] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:04.700763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f894120-fa06-44a3-9ce9-472fb2aa3ea8 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:04.701386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f894120-fa06-44a3-9ce9-472fb2aa3ea8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:04.702236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f894120-fa06-44a3-9ce9-472fb2aa3ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:04.756584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1f894120-fa06-44a3-9ce9-472fb2aa3ea8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:04.758946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1f894120-fa06-44a3-9ce9-472fb2aa3ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:04.839482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 31/64] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:04.883389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6be4f-86dc-4a00-bcf4-151208fa5ea0 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:04.883889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6be4f-86dc-4a00-bcf4-151208fa5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:04.884394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6be4f-86dc-4a00-bcf4-151208fa5ea0 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:04.887887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 32/65] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:04.911531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e770-f7a3-4603-9cea-be7c9a43c68f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:04.912030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e770-f7a3-4603-9cea-be7c9a43c68f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:04.912524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93e770-f7a3-4603-9cea-be7c9a43c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:04.963189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8c93e770-f7a3-4603-9cea-be7c9a43c68f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:04.966828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8c93e770-f7a3-4603-9cea-be7c9a43c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:04.992783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 34/66] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:05.021357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:05.140943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 33/67] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 02 20:59:05.325251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f894120-fa06-44a3-9ce9-472fb2aa3ea8 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:05.345334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:05.488020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f894120-fa06-44a3-9ce9-472fb2aa3ea8 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:05.530317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e770-f7a3-4603-9cea-be7c9a43c68f None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:05.542120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ccf7-dc66-48b1-837a-aa4d28d9e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:05.543414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ccf7-dc66-48b1-837a-aa4d28d9e7cb None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:05.543875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ccf7-dc66-48b1-837a-aa4d28d9e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:05.544201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ccf7-dc66-48b1-837a-aa4d28d9e7cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:05.563038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782ccf7-dc66-48b1-837a-aa4d28d9e7cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-4782ccf7-dc66-48b1-837a-aa4d28d9e7cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:05.570809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:05.573530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 35/68] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:05.575271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2ed49-4465-493c-aef0-f555a3189316 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:05.576077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2ed49-4465-493c-aef0-f555a3189316 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:05.576077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2ed49-4465-493c-aef0-f555a3189316 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:05.580954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 36/69] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:05.587272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2ed49-4465-493c-aef0-f555a3189316 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:05.731625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:05.782637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93e770-f7a3-4603-9cea-be7c9a43c68f None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:05.798962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2ed49-4465-493c-aef0-f555a3189316 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:05.856744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc6527-4041-4cdb-8fdc-3f02d38a1871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:05.857574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc6527-4041-4cdb-8fdc-3f02d38a1871 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:05.858030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc6527-4041-4cdb-8fdc-3f02d38a1871 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:05.858237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:05.858475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc6527-4041-4cdb-8fdc-3f02d38a1871 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:05.859347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:05.859511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc6527-4041-4cdb-8fdc-3f02d38a1871 None admin] RBAC: Adding query filter params (name=member) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:05.859848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc6527-4041-4cdb-8fdc-3f02d38a1871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:05.860016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:05.860281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:05.861730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc6527-4041-4cdb-8fdc-3f02d38a1871 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:05.874966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 37/70] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:05.875214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:05.877157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cbca9-acc1-4dbc-897f-2b9d3041d02c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:05.877916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cbca9-acc1-4dbc-897f-2b9d3041d02c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:05.878367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cbca9-acc1-4dbc-897f-2b9d3041d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:05.882673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:05.887797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 34/71] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 20:59:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 20:59:05.897715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:05.910990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-5e2cbca9-acc1-4dbc-897f-2b9d3041d02c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:05.914331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5e2cbca9-acc1-4dbc-897f-2b9d3041d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:05.929646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:06.028623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 38/72] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:06.031516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd218b-86b3-4dec-9c7c-b99e93506c72 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:06.032509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd218b-86b3-4dec-9c7c-b99e93506c72 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:06.038673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd218b-86b3-4dec-9c7c-b99e93506c72 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:06.038673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 39/73] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:06.038673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd218b-86b3-4dec-9c7c-b99e93506c72 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:06.114833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18be1-9502-4042-add2-1d7148a99767 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:06.163836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:06.188810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:06.189974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:06.190472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:06.190975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:06.211632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:06.221707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:06.223475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:06.225019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 35/74] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:59:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:06.227525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:06.258749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd218b-86b3-4dec-9c7c-b99e93506c72 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:06.336715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe709cb-cdd7-420f-a843-8ac6bad94b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:06.337852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe709cb-cdd7-420f-a843-8ac6bad94b38 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:06.338347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe709cb-cdd7-420f-a843-8ac6bad94b38 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:06.338815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe709cb-cdd7-420f-a843-8ac6bad94b38 None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:06.367158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe709cb-cdd7-420f-a843-8ac6bad94b38 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:06.370236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe709cb-cdd7-420f-a843-8ac6bad94b38 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:06.381070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 40/75] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:06 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:06.381070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b631cc0-3cdd-463d-8ee3-83973c3d04c0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:06.381070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b631cc0-3cdd-463d-8ee3-83973c3d04c0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:06.381070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b631cc0-3cdd-463d-8ee3-83973c3d04c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:06.434885 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4b631cc0-3cdd-463d-8ee3-83973c3d04c0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:06.437174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4b631cc0-3cdd-463d-8ee3-83973c3d04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:06.446787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:06.503243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc274-f7e1-4ab1-83e5-69a36c0a16e1 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:06.552963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 41/76] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:06.554474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b631cc0-3cdd-463d-8ee3-83973c3d04c0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:06.578789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:06.580938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:06.581423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:06.581930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:06.583963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:06.584768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:06.588102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:06.619167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 36/77] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 20:59:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:06.622132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:06.698155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:06.825928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b631cc0-3cdd-463d-8ee3-83973c3d04c0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:06.877268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1a31-1b17-438d-a834-23b5576cd5d7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:06.905185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:06.906176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:06.906630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:06.907095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:06.908256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:06.908829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:06.911254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:06.946079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 42/78] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:06.948143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:06.960034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:06.961684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:06.961684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:06.962104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:06.970455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:07.115509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:07.118426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:07.157748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afc4b-d67e-499b-a2e6-96c63d39064b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:07.190355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:07.234618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:07.235569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:07.236036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:07.236470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:07.256580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:07.266463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:07.268375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 43/79] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:07.270193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:07.332055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 37/80] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:07.336364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:07.399831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:07.469407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4a9f-99e9-4e8b-b878-5d0d7a505679 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:07.537549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:07.538680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:07.539195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:07.539852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:07.542154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:07.545670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:07.548544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c44c-e648-4e7c-9391-40d761f0ed83 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:07.548781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 44/81] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:07 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:07.550219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:07.630565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:07.631693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:07.632063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:07.632525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] PATH_INFO: `/v3/users/b18239f8e6e4489d8c11b7502bca0733` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:07.634790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] RBAC: Authorizing `identity:get_user(user_id=b18239f8e6e4489d8c11b7502bca0733)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:07.642885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:07.642885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 38/82] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:07 2022] GET /identity/v3/users/b18239f8e6e4489d8c11b7502bca0733 => generated 247 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:07.642885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:07.644038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:07.769422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178186e-49d3-4a17-ba30-c953e93c2d25 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:07.835197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:07.836285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:07.836801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:07.836981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ea09d-7e34-43b5-b8ed-b340d145b290 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:07.837370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:07.840303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:07.842048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:07.842489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:07.844568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 45/83] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:07.845963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:07.903095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:07.904199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:07.904690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:07.905566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:07.907181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:07.908257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:07.911025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:07.928913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 39/84] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:07.930621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:08.062550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03782a-efe0-4140-9bf4-09fa4f0ba3df None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:08.090445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:08.129982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3b5b-b787-40af-aa67-d15a110fd241 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:08.134094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:08.135134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:08.135614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:08.136462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:08.138628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:08.141244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:08.144074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 46/85] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:07 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:08.145557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:08.204645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:08.205775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:08.206240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:08.206748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:08.258813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:08.324923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:08.326485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:08.338031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bc78-6fac-4cec-9ff4-b3247bcfacaa None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:08.391743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:08.392698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:08.393190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:08.393645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:08.488154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:08.518005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 40/86] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:08.519088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:08.535032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:08.538216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:08.647521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:08.711792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdc133-d8d1-47b3-867d-bd70810f5f6c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:08.726410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 47/87] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:08.727810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:08.778461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:08.779253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:08.779617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:08.780011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:08.780953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:08.782633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:08.874509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:08.905881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab530-1b65-4894-abba-c925e3b86bba None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:08.966768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 41/88] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 20:59:08 2022] POST /identity/v3/users => generated 289 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:59:08.967935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:08.975509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:08.976912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:08.978285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:08.981116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:08.982365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:08.984906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:08.987833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 48/89] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:08 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:08.989701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:09.195568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fc2e-e4a4-4de8-a8b5-b397eda0a759 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:09.197288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbee9-d8b5-4fbd-8a66-fae5f5eafd6e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:09.258503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:09.285014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:09.286224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:09.286710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:09.287334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:09.288806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=e3e2e0ab7b844088aa2497b543aa9b63) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:09.289468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:09.292199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:09.300375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:09.301529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:09.302040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:09.302644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:09.306087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:09.309395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:09.313632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 49/90] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:08 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:09.313962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 42/91] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:08 2022] GET /identity/v3/role_assignments?user.id=e3e2e0ab7b844088aa2497b543aa9b63&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=2e8ee3364fce49668856661174d3b27d => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:09.322681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:09.322883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:09.382861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:09.632546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c2eff-3852-4ff5-ae44-9d1e20b908c9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:09.663106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576a0d-ff8f-4365-9dfa-123b5a231606 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:09.700461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:09.701179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:09.701531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:09.701864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:09.752977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:09.759185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:09.760114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:09.760277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:09.765068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:09.782951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:09.782951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 50/92] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:09 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:09.782951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:09.919690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:09.967777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:09.970082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:09.993807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:10.035317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfc48-ed76-4a0d-95fa-7967cd2163f2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:10.093664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:10.094454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:10.094749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:10.095198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:10.096617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] RBAC: Adding query filter params (role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=e3e2e0ab7b844088aa2497b543aa9b63) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:10.097095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:10.099124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:10.108581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 51/93] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:09 2022] GET /identity/v3/role_assignments?user.id=e3e2e0ab7b844088aa2497b543aa9b63&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:10.109631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:10.278255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddef06-19e6-4f96-8e0c-daebbe78e0b3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:10.340516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:10.341587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:10.341904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:10.342279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:10.343575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=b18239f8e6e4489d8c11b7502bca0733) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:10.344031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:10.346437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:10.359670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 52/95] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:10 2022] GET /identity/v3/role_assignments?user.id=b18239f8e6e4489d8c11b7502bca0733&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:10.364193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 43/95] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1044 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:10.366870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:10.418024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:10.704823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c99297-83b7-4e10-9d80-ae23ecae62f1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:10.825951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fefbb-0be7-4ab9-b71e-7bfa3fcf48b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:10.826872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fefbb-0be7-4ab9-b71e-7bfa3fcf48b9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:10.827283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fefbb-0be7-4ab9-b71e-7bfa3fcf48b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:10.827687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fefbb-0be7-4ab9-b71e-7bfa3fcf48b9 None admin] PATH_INFO: `/v3/projects/11b8c3b78c544760b7a2917f85458007` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:10.829667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fefbb-0be7-4ab9-b71e-7bfa3fcf48b9 None admin] RBAC: Authorizing `identity:get_project(project_id=11b8c3b78c544760b7a2917f85458007)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:10.831912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fefbb-0be7-4ab9-b71e-7bfa3fcf48b9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:10.835084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 53/96] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:10 2022] GET /identity/v3/projects/11b8c3b78c544760b7a2917f85458007 => generated 312 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:10.841869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:11.016926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:11.061637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c7ed4-7150-4fe7-9af6-8d6c397ba514 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:11.147642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223d3b3-71a0-4789-a4da-5257e967af88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:11.148935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d3b3-71a0-4789-a4da-5257e967af88 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:11.149559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d3b3-71a0-4789-a4da-5257e967af88 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:11.150111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d3b3-71a0-4789-a4da-5257e967af88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:11.152177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223d3b3-71a0-4789-a4da-5257e967af88 None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=11b8c3b78c544760b7a2917f85458007, user.id=e3e2e0ab7b844088aa2497b543aa9b63) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:11.152988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223d3b3-71a0-4789-a4da-5257e967af88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:11.155976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223d3b3-71a0-4789-a4da-5257e967af88 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:11.172117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 44/97] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:10 2022] GET /identity/v3/role_assignments?user.id=e3e2e0ab7b844088aa2497b543aa9b63&scope.project.id=11b8c3b78c544760b7a2917f85458007&role.id=2e8ee3364fce49668856661174d3b27d => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:13.197470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa13e-9b50-4d5f-8ddc-64e622576209 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:13.199587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa13e-9b50-4d5f-8ddc-64e622576209 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:13.200372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa13e-9b50-4d5f-8ddc-64e622576209 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:13.203292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 54/98] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:13.210294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e5ed-f352-4a1e-95c2-42ba8f57cdac None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:13.211762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e5ed-f352-4a1e-95c2-42ba8f57cdac None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:13.212713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e5ed-f352-4a1e-95c2-42ba8f57cdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:13.258627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-02c9e5ed-f352-4a1e-95c2-42ba8f57cdac None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:13.261776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-02c9e5ed-f352-4a1e-95c2-42ba8f57cdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:13.447146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 45/99] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:13.977070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0dec-aded-40dd-bf46-7ddc51cc5937 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:13.977543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0dec-aded-40dd-bf46-7ddc51cc5937 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:13.977890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0dec-aded-40dd-bf46-7ddc51cc5937 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:13.980818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 55/100] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:13.987744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f652-7dd4-4669-a272-3731edc34d24 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:13.988208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f652-7dd4-4669-a272-3731edc34d24 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:13.988670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f652-7dd4-4669-a272-3731edc34d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:14.027956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7304f652-7dd4-4669-a272-3731edc34d24 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:14.029970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7304f652-7dd4-4669-a272-3731edc34d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:14.039200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e453b-c86e-4a5d-8681-adba9c9b95ba None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:14.039656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e453b-c86e-4a5d-8681-adba9c9b95ba None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:14.040132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e453b-c86e-4a5d-8681-adba9c9b95ba None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:14.043190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 56/101] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:14.067087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1c62-e459-4d0b-9659-89f0cc5695e8 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:14.067547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1c62-e459-4d0b-9659-89f0cc5695e8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:14.068027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1c62-e459-4d0b-9659-89f0cc5695e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:14.108181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-453d1c62-e459-4d0b-9659-89f0cc5695e8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:14.109787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-453d1c62-e459-4d0b-9659-89f0cc5695e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:14.294328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 46/102] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:14.295066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f652-7dd4-4669-a272-3731edc34d24 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:14.309628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 57/103] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:14.334421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:14.531035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f652-7dd4-4669-a272-3731edc34d24 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:14.617950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:14.618522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:14.618811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:14.619093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:14.642939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:14.650286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:14.651708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:14.653630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 47/104] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:14.663511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1c62-e459-4d0b-9659-89f0cc5695e8 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:14.691620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:14.906553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1c62-e459-4d0b-9659-89f0cc5695e8 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:14.995856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:14.996977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:14.997493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:14.997790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:14.998795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] RBAC: Adding query filter params (name=reader) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:14.999207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:15.001340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:15.023073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 58/105] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:15.032917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:15.132464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:15.198824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:15.250631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bada7-20f0-46b1-9888-18eec58ab40d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:15.285029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:15.314098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb4a3c-5c64-4e72-96bf-3669caab6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:15.315086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb4a3c-5c64-4e72-96bf-3669caab6f7a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.315558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb4a3c-5c64-4e72-96bf-3669caab6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.316021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb4a3c-5c64-4e72-96bf-3669caab6f7a None admin] PATH_INFO: `/v3/users/139baa7b89704f53ab89defc16bc656e` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:15.340333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb4a3c-5c64-4e72-96bf-3669caab6f7a None admin] RBAC: Authorizing `identity:get_user(user_id=139baa7b89704f53ab89defc16bc656e)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:15.340522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb451d-429a-41b0-b5be-b1e2332370de None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:15.342505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb4a3c-5c64-4e72-96bf-3669caab6f7a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:15.350009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 48/106] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:15 2022] GET /identity/v3/users/139baa7b89704f53ab89defc16bc656e => generated 289 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:15.352070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54161287-8c83-466b-bc92-7d526664aab7 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.352516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54161287-8c83-466b-bc92-7d526664aab7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.352960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54161287-8c83-466b-bc92-7d526664aab7 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:15.355648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 49/107] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:15.358493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49840873-f17e-4816-bf31-7419fa79dd59 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.358681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49840873-f17e-4816-bf31-7419fa79dd59 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.358974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49840873-f17e-4816-bf31-7419fa79dd59 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:15.367583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 50/108] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:15.367583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49840873-f17e-4816-bf31-7419fa79dd59 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:15.410075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b2ebc-7440-4b82-a125-fc197def770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:15.411432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b2ebc-7440-4b82-a125-fc197def770a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.411939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b2ebc-7440-4b82-a125-fc197def770a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.412475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b2ebc-7440-4b82-a125-fc197def770a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:15.429319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b2ebc-7440-4b82-a125-fc197def770a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-286b2ebc-7440-4b82-a125-fc197def770a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:15.439275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:15.445054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 59/109] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 20:59:15.446424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163454-7e4a-4cb4-aadc-100d18be2841 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.447484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163454-7e4a-4cb4-aadc-100d18be2841 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.447484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163454-7e4a-4cb4-aadc-100d18be2841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:15.478182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-fc163454-7e4a-4cb4-aadc-100d18be2841 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:15.481371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-fc163454-7e4a-4cb4-aadc-100d18be2841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:15.591894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49840873-f17e-4816-bf31-7419fa79dd59 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:15.616511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 60/110] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:15.622398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163454-7e4a-4cb4-aadc-100d18be2841 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:15.649786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:15.663177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228412a5-057f-4b0f-8bfa-acbb1c9986c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:15.666425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228412a5-057f-4b0f-8bfa-acbb1c9986c1 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.666425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228412a5-057f-4b0f-8bfa-acbb1c9986c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.666425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228412a5-057f-4b0f-8bfa-acbb1c9986c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:15.667743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228412a5-057f-4b0f-8bfa-acbb1c9986c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:15.670472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228412a5-057f-4b0f-8bfa-acbb1c9986c1 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:15.672891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 51/111] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:15.681971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc9768-53b5-4869-b578-52d697224e3e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.682394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc9768-53b5-4869-b578-52d697224e3e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.683105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc9768-53b5-4869-b578-52d697224e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:15.713466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-d3bc9768-53b5-4869-b578-52d697224e3e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:15.717047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d3bc9768-53b5-4869-b578-52d697224e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:15.749892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:15.838747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163454-7e4a-4cb4-aadc-100d18be2841 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:15.864816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 52/112] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:15.864816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc9768-53b5-4869-b578-52d697224e3e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:15.936267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25b3ac-a83a-41d3-a56b-337f451f7ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:15.936969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25b3ac-a83a-41d3-a56b-337f451f7ea0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:15.937387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25b3ac-a83a-41d3-a56b-337f451f7ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:15.937674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25b3ac-a83a-41d3-a56b-337f451f7ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.054117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25b3ac-a83a-41d3-a56b-337f451f7ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:16.055744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25b3ac-a83a-41d3-a56b-337f451f7ea0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:16.070398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc9768-53b5-4869-b578-52d697224e3e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:16.125650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:16.141269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:16.142196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:16.142675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:16.143151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.144266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:16.144784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:16.146745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:16.162046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 53/113] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:16.162808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:16.177163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:16.244041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 61/114] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:16.244041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44eccf-c779-43c1-9a92-9ac80fa69949 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:16.244041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44eccf-c779-43c1-9a92-9ac80fa69949 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:16.244041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44eccf-c779-43c1-9a92-9ac80fa69949 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.244041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 62/115] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:16.244041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44eccf-c779-43c1-9a92-9ac80fa69949 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:16.386017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29c56-f660-433d-a4c3-534c6f62f035 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:16.446088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:16.446934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44eccf-c779-43c1-9a92-9ac80fa69949 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:16.447596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:16.447596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:16.448123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.449460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:16.453643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:16.511385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:16.512454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:16.512990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:16.513491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.536561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:16.542992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:16.547456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 63/116] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 20:59:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:16.549149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:16.581457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:16.665163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 54/117] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 20:59:16 2022] POST /identity/v3/projects => generated 302 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:59:16.666569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:16.713734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f20b-71b1-4212-989b-b12fa6058f45 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:16.757207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:16.779459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593c620-b605-4bf3-9d13-60f409e33049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:16.780713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593c620-b605-4bf3-9d13-60f409e33049 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:16.781316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593c620-b605-4bf3-9d13-60f409e33049 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:16.781866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593c620-b605-4bf3-9d13-60f409e33049 None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.783460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593c620-b605-4bf3-9d13-60f409e33049 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:16.785692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593c620-b605-4bf3-9d13-60f409e33049 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:16.787982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 64/118] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:16 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:16.790504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cda9-49c1-451d-b8d6-902c7ce6daf7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:16.791128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cda9-49c1-451d-b8d6-902c7ce6daf7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:16.791557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5cda9-49c1-451d-b8d6-902c7ce6daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.825443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-04a5cda9-49c1-451d-b8d6-902c7ce6daf7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:16.827659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-04a5cda9-49c1-451d-b8d6-902c7ce6daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:16.864809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77faab3-f367-4543-8efe-ce8b97358f75 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:16.940494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:16.941578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:16.942059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:16.942563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:16.944798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:16.947649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:16.951721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 55/119] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:16 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:16.959099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 65/120] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:16.960821 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:16.961444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5cda9-49c1-451d-b8d6-902c7ce6daf7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:17.013822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:17.160192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5cda9-49c1-451d-b8d6-902c7ce6daf7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:17.160498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f036-78b0-422b-9e2d-925862b52932 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:17.179481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:17.226736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:17.227998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:17.228649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:17.228874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:17.229502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:17.230367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:17.230888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:17.231990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:17.233063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:17.234416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:17.236957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:17.246701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 66/121] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 20:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:17.248278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:17.261930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:17.268406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:17.270115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 56/122] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:17.271453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:17.425539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:17.442745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee075-cad8-4c66-9699-1d98377e05ac None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:17.528983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cd80-8012-4bb6-be48-c3d03f12e551 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:17.532248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:17.533383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:17.533944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:17.534443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:17.535989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] RBAC: Adding query filter params (role.id=0c27b4872908443092ac8932ff84b018, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=139baa7b89704f53ab89defc16bc656e) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:17.536832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:17.540279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:17.561231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 57/123] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:17 2022] GET /identity/v3/role_assignments?user.id=139baa7b89704f53ab89defc16bc656e&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=0c27b4872908443092ac8932ff84b018 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:17.561231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:17.585623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:17.587201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:17.587794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:17.588355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:17.591464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:17.594631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:17.598579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 67/124] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:17 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:17.600094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:17.633416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:17.829336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf213d-6a00-4bb9-96a7-02942c85c687 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:17.869580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0abd5-b42b-4c73-b091-d0fda2733bb8 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:17.902620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:17.904264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:17.905136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:17.905918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:17.908496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:17.911859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:17.915698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 58/125] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:17 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:17.918431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:17.952352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:17.953441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:17.953922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:17.955067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:17.955694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:17.956210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:17.961656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:17.985232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 68/126] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:17.985232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:18.024808 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:18.162815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:18.169360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b70e3-3e43-4809-b676-1356782e2d06 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:18.232154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bee92-dd7a-4df5-bb7d-c0372b300e2b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:18.243607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:18.244937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:18.246232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:18.246870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:18.267508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:18.279196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:18.281210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:18.283010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:18.285331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 59/127] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:18.290889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:18.329149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:18.330425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:18.330982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:18.331569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17/users/e3e2e0ab7b844088aa2497b543aa9b63/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:18.335609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b439539190246dab7b521b2ea009f17, user_id=e3e2e0ab7b844088aa2497b543aa9b63, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:18.338281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:18.488303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 69/128] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:17 2022] PUT /identity/v3/projects/7b439539190246dab7b521b2ea009f17/users/e3e2e0ab7b844088aa2497b543aa9b63/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:59:18.489921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:18.586333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fcda7-b192-45c7-a19a-3aaaedfc97ac None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:18.697446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:18.704558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:18.706524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:18.707125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:18.707602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:18.709958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:18.715082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:18.716199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 60/129] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:18 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:18.717881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:18.756553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec89e4-a164-48ca-9dbb-48bea0572c01 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:18.778385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:18.826858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:18.828418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:18.829215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:18.830147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] PATH_INFO: `/v3/users/b18239f8e6e4489d8c11b7502bca0733` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:18.833647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] RBAC: Authorizing `identity:get_user(user_id=b18239f8e6e4489d8c11b7502bca0733)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:18.836930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:18.841469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 70/130] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:18 2022] GET /identity/v3/users/b18239f8e6e4489d8c11b7502bca0733 => generated 247 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:18.843603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:19.058696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0e2ae-e1cb-42c6-a1b3-c63d9c4170c9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:19.085431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d264-b8a7-4e7b-abda-6be1b7449bdf None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:19.128654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:19.130434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:19.131247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:19.132027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17/users/e3e2e0ab7b844088aa2497b543aa9b63/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:19.136546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] RBAC: Authorizing `identity:create_grant(project_id=7b439539190246dab7b521b2ea009f17, user_id=e3e2e0ab7b844088aa2497b543aa9b63, role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:19.140002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:19.187748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:19.189369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:19.190135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:19.190925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:19.192784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:19.193698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:19.196755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:19.216017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 61/131] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:19.224296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:19.312414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:19.325848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 71/132] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:18 2022] PUT /identity/v3/projects/7b439539190246dab7b521b2ea009f17/users/e3e2e0ab7b844088aa2497b543aa9b63/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:59:19.326987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:19.409159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:19.430131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40d67a-6618-4850-b242-3a5a2872aba9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:19.546086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:19.547560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:19.548286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:19.549050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:19.562218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:19.565569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:19.569299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 62/133] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:19 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:19.583221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:19.632773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7241e2-bb61-43bc-87c6-10b918fff93a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:19.756642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:19.759104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:19.759910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:19.761354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:19.768045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:19.781423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:19.785645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 72/134] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:19 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:19.795489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:19.986440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709bfed-5741-41b1-90aa-f17230d3afc5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:20.049154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:20.121270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2964f69-302d-4c13-b5d4-1e226663436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:20.122427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2964f69-302d-4c13-b5d4-1e226663436e None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:20.122895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2964f69-302d-4c13-b5d4-1e226663436e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:20.123379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2964f69-302d-4c13-b5d4-1e226663436e None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17/users/b18239f8e6e4489d8c11b7502bca0733/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:20.131288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2964f69-302d-4c13-b5d4-1e226663436e None admin] RBAC: Authorizing `identity:create_grant(project_id=7b439539190246dab7b521b2ea009f17, user_id=b18239f8e6e4489d8c11b7502bca0733, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:20.134094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2964f69-302d-4c13-b5d4-1e226663436e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:20.144226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312bda4-b609-409c-9c43-da35359232cf None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:20.224907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:20.226116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:20.226679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:20.227253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] PATH_INFO: `/v3/projects/11b8c3b78c544760b7a2917f85458007` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:20.231289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] RBAC: Authorizing `identity:get_project(project_id=11b8c3b78c544760b7a2917f85458007)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:20.233495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:20.236536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 73/135] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:19 2022] GET /identity/v3/projects/11b8c3b78c544760b7a2917f85458007 => generated 312 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:20.244417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:20.258120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 63/136] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:19 2022] PUT /identity/v3/projects/7b439539190246dab7b521b2ea009f17/users/b18239f8e6e4489d8c11b7502bca0733/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:59:20.329207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342b8a2-05ee-4580-9e1a-991239529ec5 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:20.329766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342b8a2-05ee-4580-9e1a-991239529ec5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:20.330250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342b8a2-05ee-4580-9e1a-991239529ec5 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:20.337027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 64/137] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:20.348850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45147251-674e-451a-a1ed-46da02a40271 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:20.348850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45147251-674e-451a-a1ed-46da02a40271 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:20.348850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45147251-674e-451a-a1ed-46da02a40271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:20.402799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-45147251-674e-451a-a1ed-46da02a40271 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:20.405067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-45147251-674e-451a-a1ed-46da02a40271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:20.447635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:20.564045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9b28-9db0-4e38-bccc-725e2381b65e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:20.641616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 65/138] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:20.655088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af278e-2b05-43a1-9ffa-4c2a6ca903eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:20.656256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af278e-2b05-43a1-9ffa-4c2a6ca903eb None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:20.656787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af278e-2b05-43a1-9ffa-4c2a6ca903eb None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:20.657305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af278e-2b05-43a1-9ffa-4c2a6ca903eb None admin] PATH_INFO: `/v3/projects/11b8c3b78c544760b7a2917f85458007/users/e3e2e0ab7b844088aa2497b543aa9b63/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:20.661398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af278e-2b05-43a1-9ffa-4c2a6ca903eb None admin] RBAC: Authorizing `identity:create_grant(project_id=11b8c3b78c544760b7a2917f85458007, user_id=e3e2e0ab7b844088aa2497b543aa9b63, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:20.664399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af278e-2b05-43a1-9ffa-4c2a6ca903eb None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:20.675014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:20.794165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 74/139] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:20 2022] PUT /identity/v3/projects/11b8c3b78c544760b7a2917f85458007/users/e3e2e0ab7b844088aa2497b543aa9b63/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:59:20.926407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0707c4-e893-4472-b3c8-180d7560cde1 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:20.927434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0707c4-e893-4472-b3c8-180d7560cde1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:20.928258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0707c4-e893-4472-b3c8-180d7560cde1 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:20.931395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 66/140] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:20.945098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157882d-64bc-4c89-b1e2-98b01cae88a0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:20.945602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157882d-64bc-4c89-b1e2-98b01cae88a0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:20.946109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157882d-64bc-4c89-b1e2-98b01cae88a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:20.989572 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-d157882d-64bc-4c89-b1e2-98b01cae88a0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:20.992032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d157882d-64bc-4c89-b1e2-98b01cae88a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:21.146447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 75/141] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:21.171975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0707c4-e893-4472-b3c8-180d7560cde1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:21.382534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0707c4-e893-4472-b3c8-180d7560cde1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:21.461617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:21.463249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:21.464676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:21.465519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:21.468095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:21.471307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:21.474950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 67/142] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:21.485162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157882d-64bc-4c89-b1e2-98b01cae88a0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:21.789913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157882d-64bc-4c89-b1e2-98b01cae88a0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:21.845608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:21.860722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:21.866232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:21.866232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:21.866232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:21.866232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:21.866730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:21.946488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:21.998405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:22.118741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 76/143] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 20:59:21 2022] POST /identity/v3/users => generated 283 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:59:22.178401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d72fb-0fe6-40e7-a997-ea308ce6e7c3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:22.252839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876a18-fb56-4dcc-ab99-a3a972937fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:22.254445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876a18-fb56-4dcc-ab99-a3a972937fb4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:22.255292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876a18-fb56-4dcc-ab99-a3a972937fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:22.256011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876a18-fb56-4dcc-ab99-a3a972937fb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:22.278644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876a18-fb56-4dcc-ab99-a3a972937fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-15876a18-fb56-4dcc-ab99-a3a972937fb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:22.288229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:22.289868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:22.291277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:22.296044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 68/144] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:22.305080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:22.322986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6be0-1d13-48b6-b351-30458ee43313 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:22.324401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6be0-1d13-48b6-b351-30458ee43313 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:22.325137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6be0-1d13-48b6-b351-30458ee43313 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:22.327977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 69/145] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:22.337039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae345de-7183-4000-8d54-c1586d8aff78 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:22.337959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae345de-7183-4000-8d54-c1586d8aff78 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:22.338750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae345de-7183-4000-8d54-c1586d8aff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:22.398329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9ae345de-7183-4000-8d54-c1586d8aff78 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:22.403589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ae345de-7183-4000-8d54-c1586d8aff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:22.670933 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 70/146] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:22.677607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ca74-0ac9-4007-9ec8-781dee670d22 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:22.814164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:22.815281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:22.815788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:22.816286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:22.817662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:22.818171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:22.820957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:22.842821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 77/147] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:22.852107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae345de-7183-4000-8d54-c1586d8aff78 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:22.885238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:23.138976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae345de-7183-4000-8d54-c1586d8aff78 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:23.220133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:23.221255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:23.221787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:23.222257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] PATH_INFO: `/v3/users/139baa7b89704f53ab89defc16bc656e` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:23.224531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] RBAC: Authorizing `identity:get_user(user_id=139baa7b89704f53ab89defc16bc656e)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:23.227398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:23.231470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 71/148] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:22 2022] GET /identity/v3/users/139baa7b89704f53ab89defc16bc656e => generated 289 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:23.241020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:23.372177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:23.504658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe7282-3aaf-4555-8399-a108784481d2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:23.518376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:23.625035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:23.626078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:23.626559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:23.627011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:23.629904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:23.631966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:23.634931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 78/149] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:23 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:23.644001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:23.783381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:23.849348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84269ee-70c8-4ed5-96d4-5c3bb4f801b9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:23.870986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463936c2-0b79-4431-ad97-73c7f499877f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:23.912074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:23.959393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:23.960899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:23.961575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:23.962214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:23.964508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c923e-e4e4-4f30-873a-caf4767f977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:23.966045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c923e-e4e4-4f30-873a-caf4767f977d None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:23.966754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c923e-e4e4-4f30-873a-caf4767f977d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:23.967429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c923e-e4e4-4f30-873a-caf4767f977d None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17/users/139baa7b89704f53ab89defc16bc656e/roles/0c27b4872908443092ac8932ff84b018` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:23.974643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c923e-e4e4-4f30-873a-caf4767f977d None admin] RBAC: Authorizing `identity:create_grant(project_id=7b439539190246dab7b521b2ea009f17, user_id=139baa7b89704f53ab89defc16bc656e, role_id=0c27b4872908443092ac8932ff84b018)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:23.976824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c923e-e4e4-4f30-873a-caf4767f977d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:23.992886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:24.005240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:24.007465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:24.010174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 72/150] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:24.022375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:24.184753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 79/151] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:23 2022] PUT /identity/v3/projects/7b439539190246dab7b521b2ea009f17/users/139baa7b89704f53ab89defc16bc656e/roles/0c27b4872908443092ac8932ff84b018 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 20:59:24.187472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545987f7-56af-486a-a6cd-bcca56704a4e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:24.188002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545987f7-56af-486a-a6cd-bcca56704a4e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:24.188475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545987f7-56af-486a-a6cd-bcca56704a4e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:24.194017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 80/152] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:24.202095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a589bd-6459-42fa-9bc7-4d10c98750da None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:24.204820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf853fe-2c27-45c5-93e7-1758dd331b3e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:24.205359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf853fe-2c27-45c5-93e7-1758dd331b3e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:24.205829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf853fe-2c27-45c5-93e7-1758dd331b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:24.255501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4cf853fe-2c27-45c5-93e7-1758dd331b3e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:24.259055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4cf853fe-2c27-45c5-93e7-1758dd331b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:24.295828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:24.296721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:24.297173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:24.297654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:24.298528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:24.298944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:24.301834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:24.304761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:24.325167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 73/153] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:24.331720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:24.447593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 81/154] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:24.605042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92877bf-1268-4f28-8c78-23fc7d95df1b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:24.738999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:24.739994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:24.740484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:24.740985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:24.742517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:24.744232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:24.752953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 74/155] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:24 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:24.756820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf853fe-2c27-45c5-93e7-1758dd331b3e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:25.083703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf853fe-2c27-45c5-93e7-1758dd331b3e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:25.086927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:25.159975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee92fe-cfd1-475c-8c63-1bb966656b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:25.164761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee92fe-cfd1-475c-8c63-1bb966656b1a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:25.164761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee92fe-cfd1-475c-8c63-1bb966656b1a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:25.164761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee92fe-cfd1-475c-8c63-1bb966656b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:25.302619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee92fe-cfd1-475c-8c63-1bb966656b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:25.305624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee92fe-cfd1-475c-8c63-1bb966656b1a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:25.498489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 82/156] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:25.507015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:25.514268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c403c-5267-495f-87ca-3b0d22283c8c None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:25.515059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c403c-5267-495f-87ca-3b0d22283c8c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:25.515695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c403c-5267-495f-87ca-3b0d22283c8c None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:25.518555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 83/157] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:25.525621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d55b4-f11f-417f-8640-4ef75df7e4f2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:25.526969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d55b4-f11f-417f-8640-4ef75df7e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:25.527654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d55b4-f11f-417f-8640-4ef75df7e4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:25.545216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:25.566937 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-176d55b4-f11f-417f-8640-4ef75df7e4f2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:25.569000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-176d55b4-f11f-417f-8640-4ef75df7e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:25.722808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:25.738918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 84/158] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:25.740599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d55b4-f11f-417f-8640-4ef75df7e4f2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:25.827983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daedad3-d9f7-4f09-a90d-55dd5f813021 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:25.899178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:25.899874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:25.900169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:25.900456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:25.902333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:25.904467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:25.908053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 75/159] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:25 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:25.921907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:26.068568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d55b4-f11f-417f-8640-4ef75df7e4f2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:26.116429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:26.124581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992619fc-047b-4c58-a2c5-bb45d7548307 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:26.129464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:26.130129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:26.130407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:26.134174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:26.150730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:26.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:26.166594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:26.167795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 85/160] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 20:59:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:26.175939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:26.194098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:26.197514 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeac9f-a073-49db-a60e-31ccf96f4364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:26.199549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeac9f-a073-49db-a60e-31ccf96f4364 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:26.200275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeac9f-a073-49db-a60e-31ccf96f4364 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:26.201058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeac9f-a073-49db-a60e-31ccf96f4364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:26.208221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeac9f-a073-49db-a60e-31ccf96f4364 None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=e3e2e0ab7b844088aa2497b543aa9b63) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:26.208221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeac9f-a073-49db-a60e-31ccf96f4364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:26.208221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeac9f-a073-49db-a60e-31ccf96f4364 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:26.220004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 76/161] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:25 2022] GET /identity/v3/role_assignments?user.id=e3e2e0ab7b844088aa2497b543aa9b63&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=2e8ee3364fce49668856661174d3b27d => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:26.392181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171abad-c384-4b2e-b705-5abef38badc6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:26.400251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f458f-b0b5-4e3f-b5fc-ba5b163f0a99 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:26.401677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f458f-b0b5-4e3f-b5fc-ba5b163f0a99 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:26.402150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f458f-b0b5-4e3f-b5fc-ba5b163f0a99 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:26.404331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 77/162] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:26.413888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7733-0a66-4c40-b7e5-85fb00e8b433 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:26.414414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7733-0a66-4c40-b7e5-85fb00e8b433 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:26.414876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7733-0a66-4c40-b7e5-85fb00e8b433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:26.465987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-390e7733-0a66-4c40-b7e5-85fb00e8b433 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:26.470063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-390e7733-0a66-4c40-b7e5-85fb00e8b433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:26.527547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:26.528705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:26.529210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:26.529716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:26.531070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:26.534038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:26.543975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:26.573400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 86/163] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 20:59:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:26.581899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:26.632782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 78/164] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:26.765666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7733-0a66-4c40-b7e5-85fb00e8b433 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:26.771535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:26.915710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99d0e-d65d-4486-9a1d-0aa53342b89e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:27.056378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7733-0a66-4c40-b7e5-85fb00e8b433 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:27.062896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:27.063723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:27.064224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:27.064759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:27.066622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:27.068536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:27.071680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 87/165] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:26 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:27.084178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:27.139804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:27.149877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:27.151505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:27.152000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:27.152501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:27.180871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:27.197217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:27.199134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:27.202666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 79/166] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:27.216405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:27.436955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf2ac0-410d-470e-bd89-439a59528e8f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:27.515928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:27.519071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddd00b-4be4-46dc-9b60-4f95a9879089 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:27.570056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:27.571175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:27.571649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:27.572114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:27.654333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:27.656589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:27.657438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:27.658252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:27.659987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:27.661048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:27.663590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:27.689304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 80/167] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:27.691131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:27.838118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:27.842003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:27.872269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:28.018518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b582f51-7a9e-4b8e-b014-16804d90e2a5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:28.119583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:28.120762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:28.125559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:28.126207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:28.159281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:28.173035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:28.174015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:28.175456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:28.176641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 81/168] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:28.177598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:28.269909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 88/169] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1188 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:28.271400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:28.369284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:28.577402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798dbe-e2be-4118-9812-233affda7f76 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:28.665949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0be45-51e9-45cd-8f29-99ff34e780c3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:28.685388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:28.733909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:28.734580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:28.734859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:28.735136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] PATH_INFO: `/v3/users/b18239f8e6e4489d8c11b7502bca0733` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:28.742788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] RBAC: Authorizing `identity:get_user(user_id=b18239f8e6e4489d8c11b7502bca0733)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:28.745053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:28.748276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 82/170] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:28 2022] GET /identity/v3/users/b18239f8e6e4489d8c11b7502bca0733 => generated 247 bytes in 572 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:28.749612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:28.846124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:28.847013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:28.847501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:28.847959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:28.849189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:28.849719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:28.852254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:28.905972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 89/171] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 633 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:28.907673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:28.942463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c5f2-f138-4980-9d8f-8440ad07846f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:29.006303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:29.007464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.007838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.008110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:29.009607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:29.011703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:29.013775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 83/172] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:28 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:29.014838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:29.109550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:29.201405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667db2-94ed-418d-8421-3ed5b1373a67 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:29.251322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:29.252388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.253379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.254254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] PATH_INFO: `/v3/users/e3e2e0ab7b844088aa2497b543aa9b63` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:29.256292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e2e0ab7b844088aa2497b543aa9b63)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:29.258612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:29.261564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 84/173] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:29 2022] GET /identity/v3/users/e3e2e0ab7b844088aa2497b543aa9b63 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:29.262867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:29.305416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:29.345414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6edca4-4420-4c7a-8e1e-2a1195c9eca2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:29.425643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace23c-2fb8-4dbd-ba14-e563f7ffcf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:29.426874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace23c-2fb8-4dbd-ba14-e563f7ffcf33 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.437530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace23c-2fb8-4dbd-ba14-e563f7ffcf33 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.438389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace23c-2fb8-4dbd-ba14-e563f7ffcf33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:29.542552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864270-69a2-4516-8d0d-f74e31a43ac3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:29.567808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:29.602740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb170d1-c1b5-441d-a0ae-b2fc8f7f2976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:29.603817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb170d1-c1b5-441d-a0ae-b2fc8f7f2976 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.605101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb170d1-c1b5-441d-a0ae-b2fc8f7f2976 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.605802 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb170d1-c1b5-441d-a0ae-b2fc8f7f2976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:29.607085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb170d1-c1b5-441d-a0ae-b2fc8f7f2976 None admin] RBAC: Adding query filter params (role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=e3e2e0ab7b844088aa2497b543aa9b63) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:29.607817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb170d1-c1b5-441d-a0ae-b2fc8f7f2976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:29.609759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb170d1-c1b5-441d-a0ae-b2fc8f7f2976 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:29.617764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 85/174] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:29 2022] GET /identity/v3/role_assignments?user.id=e3e2e0ab7b844088aa2497b543aa9b63&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:29.619518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f7eb-4807-4d60-b39c-839040fabb11 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.620868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f7eb-4807-4d60-b39c-839040fabb11 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.621589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f7eb-4807-4d60-b39c-839040fabb11 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:29.623612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 86/175] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:29.625950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f7eb-4807-4d60-b39c-839040fabb11 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:29.641288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace23c-2fb8-4dbd-ba14-e563f7ffcf33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:29.643250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace23c-2fb8-4dbd-ba14-e563f7ffcf33 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:29.829261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:29.863606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 90/176] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 957 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:29.865660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c1ec-0618-46f5-b55f-e520e360fdd8 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.869422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c1ec-0618-46f5-b55f-e520e360fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.869422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c1ec-0618-46f5-b55f-e520e360fdd8 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:29.870349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f7eb-4807-4d60-b39c-839040fabb11 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:29.880362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 91/177] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:29.880362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbada-a148-43fa-911d-c5e3fac3d5da None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.880362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbada-a148-43fa-911d-c5e3fac3d5da None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.880362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbada-a148-43fa-911d-c5e3fac3d5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:29.907688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-83ecbada-a148-43fa-911d-c5e3fac3d5da None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:29.909439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-83ecbada-a148-43fa-911d-c5e3fac3d5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:29.934489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157ae37-bbbb-4b09-adb7-f70371621fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:29.935255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ae37-bbbb-4b09-adb7-f70371621fc9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:29.935617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ae37-bbbb-4b09-adb7-f70371621fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:29.935942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ae37-bbbb-4b09-adb7-f70371621fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.021153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:30.052769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 92/178] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:30.055410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b7d0-0608-49b5-9cfc-76c79d8056ff None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:30.055869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b7d0-0608-49b5-9cfc-76c79d8056ff None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:30.056312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b7d0-0608-49b5-9cfc-76c79d8056ff None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.059709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 93/179] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:30.061572 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f864d5-76f5-4e09-b9ba-c8132ef929ad None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:30.062228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f864d5-76f5-4e09-b9ba-c8132ef929ad None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:30.062709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f864d5-76f5-4e09-b9ba-c8132ef929ad None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.065360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 94/180] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:30.066729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f864d5-76f5-4e09-b9ba-c8132ef929ad None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:30.075825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157ae37-bbbb-4b09-adb7-f70371621fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:30.079391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157ae37-bbbb-4b09-adb7-f70371621fc9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:30.256377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f864d5-76f5-4e09-b9ba-c8132ef929ad None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:30.283119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:30.285918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 87/181] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:30.287639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d42a-fb6f-44cf-aa27-14543c0ca0c2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:30.287989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d42a-fb6f-44cf-aa27-14543c0ca0c2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:30.288274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d42a-fb6f-44cf-aa27-14543c0ca0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.317833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-dee0d42a-fb6f-44cf-aa27-14543c0ca0c2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:30.319593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dee0d42a-fb6f-44cf-aa27-14543c0ca0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:30.325614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9de7d-b568-4dab-bec8-4fcd93c3b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:30.326308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9de7d-b568-4dab-bec8-4fcd93c3b64f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:30.326743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9de7d-b568-4dab-bec8-4fcd93c3b64f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:30.327086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9de7d-b568-4dab-bec8-4fcd93c3b64f None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.328776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9de7d-b568-4dab-bec8-4fcd93c3b64f None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:30.330346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9de7d-b568-4dab-bec8-4fcd93c3b64f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:30.338261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 95/182] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:30 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:30.339819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac884c-df2f-47b6-b251-65f6c7d069da None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:30.340103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac884c-df2f-47b6-b251-65f6c7d069da None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:30.340384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac884c-df2f-47b6-b251-65f6c7d069da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.371118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-42ac884c-df2f-47b6-b251-65f6c7d069da None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:30.372895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-42ac884c-df2f-47b6-b251-65f6c7d069da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:30.458365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 88/183] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:30.460502 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ebd2a-732c-4060-883e-e98632663fb5 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:30.461371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ebd2a-732c-4060-883e-e98632663fb5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:30.461952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ebd2a-732c-4060-883e-e98632663fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.485835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:30.496243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-db2ebd2a-732c-4060-883e-e98632663fb5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:30.498862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-db2ebd2a-732c-4060-883e-e98632663fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:30.506537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 96/184] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:30.509299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac884c-df2f-47b6-b251-65f6c7d069da None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:30.702039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 89/185] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:30.703369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ebd2a-732c-4060-883e-e98632663fb5 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:30.828574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac884c-df2f-47b6-b251-65f6c7d069da None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:30.872410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:30.896228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ebd2a-732c-4060-883e-e98632663fb5 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:30.918594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:30.919247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:30.919528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:30.919798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] PATH_INFO: `/v3/projects/11b8c3b78c544760b7a2917f85458007` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:30.921764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] RBAC: Authorizing `identity:get_project(project_id=11b8c3b78c544760b7a2917f85458007)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:30.924398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:30.927058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 97/186] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:30 2022] GET /identity/v3/projects/11b8c3b78c544760b7a2917f85458007 => generated 312 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:30.928481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:31.001276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:31.002113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:31.002518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:31.003143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:31.004017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=b18239f8e6e4489d8c11b7502bca0733) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:31.004427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:31.006789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:31.013925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:31.024967 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 90/187] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:30 2022] GET /identity/v3/role_assignments?user.id=b18239f8e6e4489d8c11b7502bca0733&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:31.024967 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:31.160204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2dc81-a3a7-469e-8542-3e06e4c1ad8a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:31.234464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cfa07-35d0-4527-b576-bf86706d9369 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:31.235240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:31.236140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:31.236639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:31.237215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:31.266449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:31.274009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:31.275631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 98/188] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:31.277499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:31.324415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:31.325981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:31.326433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:31.326873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:31.360566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:31.371892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:31.373272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:31.374241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 91/189] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:31.376601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:31.379578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:31.487993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:31.489393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5528a4-e6b2-4955-bf2a-8b0ca8b8ac55 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:31.552133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:31.553156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:31.553553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:31.554011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:31.555438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=11b8c3b78c544760b7a2917f85458007, user.id=e3e2e0ab7b844088aa2497b543aa9b63) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:31.556041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:31.558534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:31.560623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcde49-f0da-431f-b628-841bab9b83c9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:31.568667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 99/190] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:31 2022] GET /identity/v3/role_assignments?user.id=e3e2e0ab7b844088aa2497b543aa9b63&scope.project.id=11b8c3b78c544760b7a2917f85458007&role.id=2e8ee3364fce49668856661174d3b27d => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:31.569769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:31.642409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:31.643610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:31.644203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:31.644560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:31.646942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:31.649783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:31.653525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 92/191] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:31.656878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:31.816889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84615d4-dd68-4447-a5b4-13d1e35f0e46 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:31.821418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:31.897913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:31.898919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:31.899347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:31.899782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:31.901505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:31.902003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:31.904684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:31.907518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b89deb-c284-499e-a2f4-16c098f585b6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:31.922314 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 100/192] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:31.928771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:31.970501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:31.987882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:31.988964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:31.989243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:31.993719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:32.006466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:32.013222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:32.015095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:32.015998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 93/193] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 20:59:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:32.017640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:32.150087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088f403-e062-4b03-ad9e-554ac9a8d1d5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:32.218116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:32.219080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:32.219513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:32.219927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:32.221101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:32.221750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:32.225763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:32.228322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85a35d-d23c-4850-b54c-de7bd3b843a7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:32.245068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 101/194] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:32.245068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:32.278347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:32.279337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:32.279744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:32.280205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:32.280625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:32.282899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:32.303568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:32.421302 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db5b18-f863-489a-a2d0-e94e74c8c24e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:32.443888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 94/195] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 20:59:32 2022] POST /identity/v3/users => generated 297 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:59:32.445520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:32.500313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:32.501590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:32.504821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:32.504821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] PATH_INFO: `/v3/users/e9c4492e6e064c5c950593f929be3ce3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:32.541473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] RBAC: Authorizing `identity:get_user(user_id=e9c4492e6e064c5c950593f929be3ce3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:32.544466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:32.554478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 102/196] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:32 2022] GET /identity/v3/users/e9c4492e6e064c5c950593f929be3ce3 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:32.554478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:32.562283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:32.692539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea8786-6afa-4c29-83e3-5c808759bebf None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:32.761045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:32.781801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:32.782838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:32.783225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:32.789977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:32.789977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:32.789977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:32.789977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:32.810991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 95/197] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 20:59:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:32.810991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:32.811352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b246f-e1ef-4deb-a875-b333f48db070 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:32.889010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:32.889676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:32.889959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:32.890227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] PATH_INFO: `/v3/users/139baa7b89704f53ab89defc16bc656e` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:32.892196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] RBAC: Authorizing `identity:get_user(user_id=139baa7b89704f53ab89defc16bc656e)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:32.895225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:32.898539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 103/198] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:32 2022] GET /identity/v3/users/139baa7b89704f53ab89defc16bc656e => generated 289 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:32.900106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:33.024775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f272eab-db38-4fc4-bacd-434860ba79fa None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:33.034000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:33.068432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:33.069645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:33.069645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:33.069886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:33.092133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c792cd8-127d-40ce-8fb8-c2691c1c6253 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:33.151632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:33.152637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:33.153293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:33.156141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] PATH_INFO: `/v3/users/e9c4492e6e064c5c950593f929be3ce3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:33.158268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e9c4492e6e064c5c950593f929be3ce3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:33.161434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:33.164466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 104/199] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:32 2022] GET /identity/v3/users/e9c4492e6e064c5c950593f929be3ce3 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:33.170975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:33.233380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:33.234939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:33.238141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:33.387176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9762-d40b-462f-9b5c-9c665c1e18a3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:33.421485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 96/200] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:33.422771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:33.434644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:33.470627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:33.472222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:33.472889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:33.473418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:33.636536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:33.638291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9aea-a3bc-437a-9c54-91c4ea7ac294 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:33.639444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:33.680950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:33.713109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:33.714280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:33.714698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:33.714900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:33.820645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 105/201] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:33.822313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:33.835893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:33.837968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:33.849499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:33.991227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a18f7-c0e1-4b7a-bfe9-c1d6322d7e92 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:34.028398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 97/202] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:34.038763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:34.044637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:34.063379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:34.064684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:34.065338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:34.065983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:34.068009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:34.070466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:34.074460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 106/203] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:33 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:34.075703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:34.243906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322b96a-f7d4-4e11-b41a-eceee82922c9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:34.248143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cddf-3011-435f-9bc6-a36924b2ed50 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:34.264118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:34.292552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:34.294677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:34.295552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:34.296559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:34.299166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:34.301821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:34.305393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 107/204] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:34 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:34.307961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:34.331323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:34.332456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:34.332978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:34.333467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:34.335793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:34.339293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:34.343124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 98/205] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:34 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:34.344657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:34.430938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:34.518290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe34b3-d33e-43a6-9dc1-1994fdb593e0 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:34.577990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561e51-2a59-4d93-9588-5ae7370e74f9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:34.585972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:34.587189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:34.587792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:34.588578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:34.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=e9c4492e6e064c5c950593f929be3ce3) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:34.590961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:34.593409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:34.602126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 108/206] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:34 2022] GET /identity/v3/role_assignments?user.id=e9c4492e6e064c5c950593f929be3ce3&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:34.603745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:34.640179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4d6fb-b441-4152-9288-e77ae892b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:34.640865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4d6fb-b441-4152-9288-e77ae892b6bf None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:34.641189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4d6fb-b441-4152-9288-e77ae892b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:34.641540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4d6fb-b441-4152-9288-e77ae892b6bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:34.642335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4d6fb-b441-4152-9288-e77ae892b6bf None admin] RBAC: Adding query filter params (role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=e9c4492e6e064c5c950593f929be3ce3) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:34.642654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4d6fb-b441-4152-9288-e77ae892b6bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:34.644189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4d6fb-b441-4152-9288-e77ae892b6bf None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:34.651800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 99/207] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:34 2022] GET /identity/v3/role_assignments?user.id=e9c4492e6e064c5c950593f929be3ce3&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:34.962618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d65a-f360-4d68-88c7-fa452de1fc32 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:35.032811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:35.065221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807567-d0b9-4490-96bd-a56f2e7a3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:35.066754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807567-d0b9-4490-96bd-a56f2e7a3af7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:35.067540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807567-d0b9-4490-96bd-a56f2e7a3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:35.068270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807567-d0b9-4490-96bd-a56f2e7a3af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:35.069955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807567-d0b9-4490-96bd-a56f2e7a3af7 None admin] RBAC: Adding query filter params (role.id=0c27b4872908443092ac8932ff84b018, scope.project.id=7b439539190246dab7b521b2ea009f17, user.id=139baa7b89704f53ab89defc16bc656e) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:35.070773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807567-d0b9-4490-96bd-a56f2e7a3af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:35.074493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807567-d0b9-4490-96bd-a56f2e7a3af7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:35.094506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 109/208] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:34 2022] GET /identity/v3/role_assignments?user.id=139baa7b89704f53ab89defc16bc656e&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=0c27b4872908443092ac8932ff84b018 => generated 608 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:35.756305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4072a1-c222-4ea4-9cef-6f77051d08d0 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:35.756850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4072a1-c222-4ea4-9cef-6f77051d08d0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:35.757307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4072a1-c222-4ea4-9cef-6f77051d08d0 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:35.759919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 100/209] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:35.776708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527367c-5815-45b5-a884-3b03473e9f8c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:35.777822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527367c-5815-45b5-a884-3b03473e9f8c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:35.778602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527367c-5815-45b5-a884-3b03473e9f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:35.813374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68196c6-3094-4203-a0e9-1051ebad24be None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:35.813374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68196c6-3094-4203-a0e9-1051ebad24be None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:35.813374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68196c6-3094-4203-a0e9-1051ebad24be None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:35.814250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 101/210] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:35.822699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a4c88-a8dd-40ab-988b-1f43f11b2a62 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:35.823622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a4c88-a8dd-40ab-988b-1f43f11b2a62 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:35.823807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a4c88-a8dd-40ab-988b-1f43f11b2a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:35.825642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a527367c-5815-45b5-a884-3b03473e9f8c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:35.829751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a527367c-5815-45b5-a884-3b03473e9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:35.857079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a73a4c88-a8dd-40ab-988b-1f43f11b2a62 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:35.858953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a73a4c88-a8dd-40ab-988b-1f43f11b2a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:35.950518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:36.002011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 110/211] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:36.016606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 102/212] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:36.349052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527367c-5815-45b5-a884-3b03473e9f8c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:36.486430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a4c88-a8dd-40ab-988b-1f43f11b2a62 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:36.498758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527367c-5815-45b5-a884-3b03473e9f8c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:36.545387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:36.561567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:36.562412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:36.562703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:36.563402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:36.565889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:36.570179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:36.574633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 111/213] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:36.582752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:36.705491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a4c88-a8dd-40ab-988b-1f43f11b2a62 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:36.800107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b38b5-f36e-4bc4-988e-4e30f3198e38 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:36.800442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:36.801454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:36.801952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:36.802443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:36.827889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:36.838265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:36.843088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:36.844872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 103/214] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:36.850599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:36.892884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:36.894594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:36.895388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:36.896245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:36.897857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:36.901898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:36.914598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:37.097872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d56f-8cf9-4d02-b776-769d9966c088 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:37.136901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 112/215] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 20:59:36 2022] POST /identity/v3/users => generated 297 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:59:37.179999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:37.180852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:37.181174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:37.181470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:37.183010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:37.183606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:37.185952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:37.199301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 104/216] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:37.205800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:37.302595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:37.427449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d080-f657-47e2-8afa-b63c2a7fcc09 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:37.488262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08a6b2-6b91-4c54-976c-98b6ea4dabf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:37.489593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08a6b2-6b91-4c54-976c-98b6ea4dabf7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:37.490353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08a6b2-6b91-4c54-976c-98b6ea4dabf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:37.491062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08a6b2-6b91-4c54-976c-98b6ea4dabf7 None admin] PATH_INFO: `/v3/users/fe88c279297e4c36a4ab2b75f9934fb9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:37.520778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08a6b2-6b91-4c54-976c-98b6ea4dabf7 None admin] RBAC: Authorizing `identity:get_user(user_id=fe88c279297e4c36a4ab2b75f9934fb9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:37.523881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08a6b2-6b91-4c54-976c-98b6ea4dabf7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:37.530610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 113/217] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:37 2022] GET /identity/v3/users/fe88c279297e4c36a4ab2b75f9934fb9 => generated 297 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:37.538575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:37.723273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:37.735820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab162-7a78-475b-ad41-42ff5f97b5e5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:37.775297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:37.776202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:37.776518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:37.776835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:37.807486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178e72-d513-4f7a-aa83-8c06e1980b31 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:37.808088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178e72-d513-4f7a-aa83-8c06e1980b31 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:37.808403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178e72-d513-4f7a-aa83-8c06e1980b31 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:37.811063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 114/218] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:37.819719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690b09d-b13c-470b-8edd-d9c4837ce568 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:37.820183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690b09d-b13c-470b-8edd-d9c4837ce568 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:37.820666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690b09d-b13c-470b-8edd-d9c4837ce568 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:37.824601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 115/219] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:37.828926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297d9c9-4b78-4516-838f-64b5d4060dda None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:37.829416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297d9c9-4b78-4516-838f-64b5d4060dda None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:37.829860 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297d9c9-4b78-4516-838f-64b5d4060dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:37.872495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f297d9c9-4b78-4516-838f-64b5d4060dda None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:37.874474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f297d9c9-4b78-4516-838f-64b5d4060dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:37.881895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:37.884196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:37.984858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 116/220] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:37.984858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebab7d-1369-4abe-a061-f96cb5946191 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:37.984858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebab7d-1369-4abe-a061-f96cb5946191 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:37.984858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebab7d-1369-4abe-a061-f96cb5946191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:38.004520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c9ebab7d-1369-4abe-a061-f96cb5946191 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:38.006644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c9ebab7d-1369-4abe-a061-f96cb5946191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:38.031268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:38.034886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:38.065204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 105/221] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:38.076230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:38.102136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 117/222] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:38.238438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75e394-4a4d-493d-8140-99b7bb66b84a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:38.323164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:38.324200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:38.324670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:38.325174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:38.327286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:38.330141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:38.333776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 106/223] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:38 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:38.341388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebab7d-1369-4abe-a061-f96cb5946191 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:38.382957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:38.565968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebab7d-1369-4abe-a061-f96cb5946191 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:38.588604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:38.643474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee145ac-f5dc-4919-b81f-00bda5fedab7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:38.694874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:38.695536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:38.695822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:38.696097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:38.705337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:38.706565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:38.707058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:38.707551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:38.708964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=fe88c279297e4c36a4ab2b75f9934fb9) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:38.709480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:38.710161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:38.712446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:38.717640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:38.718609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:38.719403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 107/224] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 20:59:38.725783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 118/225] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:38 2022] GET /identity/v3/role_assignments?user.id=fe88c279297e4c36a4ab2b75f9934fb9&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=2e8ee3364fce49668856661174d3b27d => generated 259 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:38.738704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:38.772035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:38.826733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:39.027914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2cd0-6c6f-43ff-bb12-148d7d04de4a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:39.055800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:39.091105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b409d4-3888-4286-804c-0e8bab7921ea None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:39.105073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:39.105999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:39.106390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:39.106756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:39.112874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:39.112874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:39.112874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:39.126940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 108/226] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:39.134538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:39.238070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:39.239318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:39.239817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:39.240303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:39.278352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292edc24-71f7-42a7-9d30-16589721e63d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:39.282859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:39.302569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:39.303655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:39.304429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:39.306278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 119/227] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 20:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 533 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 20:59:39.315127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:39.333870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:39.335094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:39.335713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:39.336363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] PATH_INFO: `/v3/users/e9c4492e6e064c5c950593f929be3ce3` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:39.344568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] RBAC: Authorizing `identity:get_user(user_id=e9c4492e6e064c5c950593f929be3ce3)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:39.348116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:39.352188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 109/228] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:39 2022] GET /identity/v3/users/e9c4492e6e064c5c950593f929be3ce3 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:39.374807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:39.448200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:39.526146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043fb4-d5ec-4fa8-800a-fa76989f82a8 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:39.567067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:39.602177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:39.603574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:39.604923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:39.605433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:39.607529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:39.609669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:39.612305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 110/229] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:39 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:39.621229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:39.639543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a159dc-86c0-4f31-8ce2-1c6662e95ead None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:39.731324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:39.732679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:39.732993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:39.733274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:39.734046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:39.734478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:39.735995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:39.748342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 120/230] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 20:59:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:39.756292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:39.923753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f3423-3672-45e9-9d6c-39414fecd44b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:39.965110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:40.004359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:40.005820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:40.006800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:40.022731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/e9c4492e6e064c5c950593f929be3ce3/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:40.022731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1956032a34d4caa2f7a4aaea0bafe, user_id=e9c4492e6e064c5c950593f929be3ce3, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:40.022731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:40.061463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c16861-7538-4077-b4c2-1be33ba7755e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:40.136307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:40.137449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:40.138020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:40.138517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] PATH_INFO: `/v3/users/e9c4492e6e064c5c950593f929be3ce3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:40.140701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] RBAC: Authorizing `identity:get_user(user_id=e9c4492e6e064c5c950593f929be3ce3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:40.143710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:40.147268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 121/231] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:39 2022] GET /identity/v3/users/e9c4492e6e064c5c950593f929be3ce3 => generated 283 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:40.157182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:40.172347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 111/232] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:39 2022] PUT /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/e9c4492e6e064c5c950593f929be3ce3/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 20:59:40.199586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:40.392150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff243f4-5693-4fea-9c33-6a878c399cda None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:40.478272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d111da7-ac6a-4fb0-b617-78b41e70a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:40.479543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d111da7-ac6a-4fb0-b617-78b41e70a50d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:40.480049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d111da7-ac6a-4fb0-b617-78b41e70a50d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:40.481969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d111da7-ac6a-4fb0-b617-78b41e70a50d None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:40.482846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d111da7-ac6a-4fb0-b617-78b41e70a50d None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:40.485619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d111da7-ac6a-4fb0-b617-78b41e70a50d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:40.489426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 122/233] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:40 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:40.499104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:40.738372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053caea-caf9-4854-be12-1fdd6f0c800d None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:40.739279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053caea-caf9-4854-be12-1fdd6f0c800d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:40.739279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053caea-caf9-4854-be12-1fdd6f0c800d None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:40.740491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 123/234] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:40.746046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5df7-9b6a-4bb6-8a5b-1ee1bb576651 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:40.746451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5df7-9b6a-4bb6-8a5b-1ee1bb576651 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:40.746706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c5df7-9b6a-4bb6-8a5b-1ee1bb576651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:40.785999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b51c5df7-9b6a-4bb6-8a5b-1ee1bb576651 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:40.787265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b51c5df7-9b6a-4bb6-8a5b-1ee1bb576651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:40.806053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c422a-e291-4a30-97cc-5ccf190938cf None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:40.855591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9778e1-7434-4828-afcc-3d9383e8cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:40.857778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9778e1-7434-4828-afcc-3d9383e8cd2b None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:40.859132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9778e1-7434-4828-afcc-3d9383e8cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:40.859808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9778e1-7434-4828-afcc-3d9383e8cd2b None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/e9c4492e6e064c5c950593f929be3ce3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:40.864930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9778e1-7434-4828-afcc-3d9383e8cd2b None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1956032a34d4caa2f7a4aaea0bafe, user_id=e9c4492e6e064c5c950593f929be3ce3, role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:40.867581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9778e1-7434-4828-afcc-3d9383e8cd2b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:40.932576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 124/235] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:41.056187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 112/236] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:40 2022] PUT /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/e9c4492e6e064c5c950593f929be3ce3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 20:59:41.131819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a98750-b163-4bf6-ab87-e354e861ff5e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:41.132633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a98750-b163-4bf6-ab87-e354e861ff5e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:41.133333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a98750-b163-4bf6-ab87-e354e861ff5e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:41.136427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 125/237] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:41.144797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826d755-2521-4baf-8df3-567bed111ccd None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:41.145543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826d755-2521-4baf-8df3-567bed111ccd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:41.146117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826d755-2521-4baf-8df3-567bed111ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:41.172811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e826d755-2521-4baf-8df3-567bed111ccd None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:41.175007 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e826d755-2521-4baf-8df3-567bed111ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:41.216300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:41.291788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 113/238] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:41.422631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a98750-b163-4bf6-ab87-e354e861ff5e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:41.455861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:41.675581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a98750-b163-4bf6-ab87-e354e861ff5e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:41.765717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb469a-639d-44ca-9d77-6a5899f0064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:41.766688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb469a-639d-44ca-9d77-6a5899f0064b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:41.767031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb469a-639d-44ca-9d77-6a5899f0064b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:41.767452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb469a-639d-44ca-9d77-6a5899f0064b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:41.802620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb469a-639d-44ca-9d77-6a5899f0064b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-30fb469a-639d-44ca-9d77-6a5899f0064b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:41.812868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:41.814776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:41.816376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 126/239] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:41.825059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826d755-2521-4baf-8df3-567bed111ccd None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:41.826262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cc81-b720-4714-8e7f-ca95974be320 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:41.826781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cc81-b720-4714-8e7f-ca95974be320 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:41.827287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cc81-b720-4714-8e7f-ca95974be320 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:41.830594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 127/240] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:41.842202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb0d6-dd62-4f99-9c2c-1535d997f1d0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:41.843008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb0d6-dd62-4f99-9c2c-1535d997f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:41.845327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb0d6-dd62-4f99-9c2c-1535d997f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:41.900992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-31fdb0d6-dd62-4f99-9c2c-1535d997f1d0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:41.908059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-31fdb0d6-dd62-4f99-9c2c-1535d997f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:42.047590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:42.059361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 128/241] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:42.060723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb0d6-dd62-4f99-9c2c-1535d997f1d0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:42.073311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826d755-2521-4baf-8df3-567bed111ccd None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:42.177238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:42.178245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:42.178245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:42.178531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:42.179080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:42.179383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:42.180858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:42.210741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 114/242] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:42.219007 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:42.256501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:42.346385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb0d6-dd62-4f99-9c2c-1535d997f1d0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:42.400011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3633d-6e80-464f-bf4e-e0f02f5cae1e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:42.418671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:42.419433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:42.419717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:42.419994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:42.423237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:42.424774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:42.426756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 129/243] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:42.432495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:42.472510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:42.474020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:42.475300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:42.475996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] PATH_INFO: `/v3/users/088fdf75e87e4cd591a1990118b28878` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:42.508000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=088fdf75e87e4cd591a1990118b28878)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:42.512289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:42.518052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 115/244] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:42 2022] GET /identity/v3/users/088fdf75e87e4cd591a1990118b28878 => generated 297 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:42.520249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:42.586629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:42.659048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7656-f94b-402c-bf16-5ca52190191e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:42.685104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:42.720052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b48341-73b6-4a0d-9c1d-697e7c9cb6a7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:42.726848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:42.728426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:42.729417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:42.730436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:42.751945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:42.763343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:42.765164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:42.767360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:42.771858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 130/245] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:42.773707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:42.800610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:42.801763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:42.802294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:42.802825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:42.804286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:42.808522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:42.949149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09517fc7-93f0-4dc4-9a2a-bc2f70077a2b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:43.021867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 116/246] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 20:59:42 2022] POST /identity/v3/users => generated 293 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 20:59:43.036362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:43.036551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:43.065061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24538169-b872-4e70-a8b2-5eb1e8cfaf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:43.066449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24538169-b872-4e70-a8b2-5eb1e8cfaf54 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:43.066947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24538169-b872-4e70-a8b2-5eb1e8cfaf54 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:43.067430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24538169-b872-4e70-a8b2-5eb1e8cfaf54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:43.347756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24538169-b872-4e70-a8b2-5eb1e8cfaf54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:43.351656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24538169-b872-4e70-a8b2-5eb1e8cfaf54 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:43.428022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893faa0-ad09-4c35-8cb0-d9d59802de22 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:43.535521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:43.536612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:43.540342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:43.540342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:43.541347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:43.541913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:43.567970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:43.571145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 117/247] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:43.580845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:43.601652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:43.636271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 131/248] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 863 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:43.638910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1aacc-99e4-4864-b164-e03e43a70018 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:43.640544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1aacc-99e4-4864-b164-e03e43a70018 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:43.641112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1aacc-99e4-4864-b164-e03e43a70018 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:43.643145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 132/249] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:43.644713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1aacc-99e4-4864-b164-e03e43a70018 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:43.689570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:43.812829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dfdf7-2229-4176-9b67-b295d6935cb0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:43.857272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1aacc-99e4-4864-b164-e03e43a70018 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:43.898685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee32547-a46b-4442-a8a6-58bb5329c399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:43.901977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32547-a46b-4442-a8a6-58bb5329c399 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:43.903408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32547-a46b-4442-a8a6-58bb5329c399 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:43.904185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32547-a46b-4442-a8a6-58bb5329c399 None admin] PATH_INFO: `/v3/users/fe88c279297e4c36a4ab2b75f9934fb9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:43.908043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee32547-a46b-4442-a8a6-58bb5329c399 None admin] RBAC: Authorizing `identity:get_user(user_id=fe88c279297e4c36a4ab2b75f9934fb9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:43.912988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee32547-a46b-4442-a8a6-58bb5329c399 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:43.918341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 118/250] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:43 2022] GET /identity/v3/users/fe88c279297e4c36a4ab2b75f9934fb9 => generated 297 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:43.921227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb58c-998a-4432-b824-2e1143991f32 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:43.922144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb58c-998a-4432-b824-2e1143991f32 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:43.922895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb58c-998a-4432-b824-2e1143991f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:43.935370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a6c94-4793-467f-8528-68dffa8e9f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:43.936438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a6c94-4793-467f-8528-68dffa8e9f83 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:43.936992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a6c94-4793-467f-8528-68dffa8e9f83 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:43.937476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a6c94-4793-467f-8528-68dffa8e9f83 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:43.939613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a6c94-4793-467f-8528-68dffa8e9f83 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:43.942444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a6c94-4793-467f-8528-68dffa8e9f83 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:43.945735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 133/251] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:43 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:43.953827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380d63-bdc1-4ffa-86a8-2160d5d8edd0 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:43.954090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380d63-bdc1-4ffa-86a8-2160d5d8edd0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:43.954431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380d63-bdc1-4ffa-86a8-2160d5d8edd0 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:43.956112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 134/252] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:43.956962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77380d63-bdc1-4ffa-86a8-2160d5d8edd0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:43.962667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-dffbb58c-998a-4432-b824-2e1143991f32 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:43.967728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dffbb58c-998a-4432-b824-2e1143991f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:44.097372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 119/253] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:44.099793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef661ff-8d73-47ff-91f5-6243c68984dd None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:44.100352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef661ff-8d73-47ff-91f5-6243c68984dd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:44.100891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef661ff-8d73-47ff-91f5-6243c68984dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:44.133176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:44.136437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:44.148628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77380d63-bdc1-4ffa-86a8-2160d5d8edd0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:44.166477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2ef661ff-8d73-47ff-91f5-6243c68984dd None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:44.168851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2ef661ff-8d73-47ff-91f5-6243c68984dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:44.233416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:44.234276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:44.234750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:44.235237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:44.240940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:44.243070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:44.253292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 135/254] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:43 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:44.257713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:44.323683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 120/255] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:44.325117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef661ff-8d73-47ff-91f5-6243c68984dd None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:44.456351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef661ff-8d73-47ff-91f5-6243c68984dd None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:44.504878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:44.506119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:44.506620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:44.507097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/fe88c279297e4c36a4ab2b75f9934fb9/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:44.509383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:44.514135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1956032a34d4caa2f7a4aaea0bafe, user_id=fe88c279297e4c36a4ab2b75f9934fb9, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:44.516045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:44.537422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef8443-28e7-4ebe-8cce-1f41d4b2a3e5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:44.616422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:44.617537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:44.618078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:44.618665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:44.620193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] RBAC: Adding query filter params (role.id=0c27b4872908443092ac8932ff84b018, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=088fdf75e87e4cd591a1990118b28878) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:44.620912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:44.626613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:44.636599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 136/256] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:44 2022] GET /identity/v3/role_assignments?user.id=088fdf75e87e4cd591a1990118b28878&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=0c27b4872908443092ac8932ff84b018 => generated 259 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:44.647406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:44.672982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 121/257] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:44 2022] PUT /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/fe88c279297e4c36a4ab2b75f9934fb9/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:59:44.719962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:44.843512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836408e-7de3-4305-bf91-937b05ac6657 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:44.908779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:44.909954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:44.909954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:44.910409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:44.928279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:44.933998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:44.937063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:44.939730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 137/258] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 20:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:44.951193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:45.125408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fbaec-28a3-4dec-9114-3c84d3253f11 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:45.185709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:45.186375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:45.186647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:45.186928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:45.187631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:45.187942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:45.189484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:45.201485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 122/259] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:45.210620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:45.236862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:45.331913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:45.423256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20189256-9cb7-4116-9b1d-0d4db2c0dd8c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:45.434280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:45.456975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe6d8-3245-4a39-9ddf-bbef49b783e5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:45.497446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:45.504976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:45.504976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:45.504976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:45.519080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:45.520088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:45.521017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:45.521587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:45.522065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] PATH_INFO: `/v3/users/e9c4492e6e064c5c950593f929be3ce3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:45.529649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] RBAC: Authorizing `identity:get_user(user_id=e9c4492e6e064c5c950593f929be3ce3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:45.531606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:45.533869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 138/260] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:45 2022] GET /identity/v3/users/e9c4492e6e064c5c950593f929be3ce3 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:45.535266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:45.536261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 20:59:45.537086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:45.542043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:45.547985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 123/261] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 20:59:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 20:59:45.551544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:45.710737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3306fb2-568c-4560-96ac-720708d03658 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:45.762080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:45.762734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:45.763012 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:45.763287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:45.796631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:45.854306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:45.856069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:45.859133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce1757-d1e2-40c6-b3f8-d10dd2167ded None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:45.891170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:45.951654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:45.952061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:45.952346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:45.952627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:45.953366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:45.953677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:45.955758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:45.977578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 124/262] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 20:59:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:45.987772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:45.993685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 139/263] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 20:59:46.001936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:46.087013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:46.141095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40973f5-ea64-4f78-9765-52b8a9b5cb65 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:46.177236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e56f1-af00-4871-b8f2-d4e3667dd280 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:46.225425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:46.226358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:46.226642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:46.226922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] PATH_INFO: `/v3/users/e9c4492e6e064c5c950593f929be3ce3` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:46.230923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] RBAC: Authorizing `identity:get_user(user_id=e9c4492e6e064c5c950593f929be3ce3)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:46.233277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:46.235040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 125/264] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:45 2022] GET /identity/v3/users/e9c4492e6e064c5c950593f929be3ce3 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:46.243597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:46.266244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:46.267560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:46.268594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:46.269121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:46.273703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:46.280438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:46.282348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 140/265] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:46 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:46.293896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:46.365457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:46.523159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcb00-3ee6-4bf5-9d4e-99c253b2d434 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:46.591476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b38fd-ca8e-4260-9c2e-290e2f2cdb70 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:46.617026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:46.617668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:46.617955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:46.618244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:46.649281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:46.672914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:46.688928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:46.688928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:46.688928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:46.688928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=e9c4492e6e064c5c950593f929be3ce3) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:46.688928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:46.688928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:46.690147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 141/266] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:46 2022] GET /identity/v3/role_assignments?user.id=e9c4492e6e064c5c950593f929be3ce3&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:46.723296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:46.724847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:46.789224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:46.876100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 126/267] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:46.882821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:47.062625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181310cc-025e-4e46-85f3-053f39412e7e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:47.125026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ed363-7ef2-4bb5-ab19-6bbee4074452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:47.125671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ed363-7ef2-4bb5-ab19-6bbee4074452 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:47.125953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ed363-7ef2-4bb5-ab19-6bbee4074452 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:47.126226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ed363-7ef2-4bb5-ab19-6bbee4074452 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:47.127434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ed363-7ef2-4bb5-ab19-6bbee4074452 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:47.129200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ed363-7ef2-4bb5-ab19-6bbee4074452 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:47.131382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 142/268] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:46 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:47.137610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:47.149651 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0a9a-9927-4823-8548-3b49fc692e09 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:47.149973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0a9a-9927-4823-8548-3b49fc692e09 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:47.150748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0a9a-9927-4823-8548-3b49fc692e09 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:47.152304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 143/269] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:47.162306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9486b-33b3-413f-86cb-374700399b00 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:47.162594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9486b-33b3-413f-86cb-374700399b00 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:47.163042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9486b-33b3-413f-86cb-374700399b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:47.193464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-8cc9486b-33b3-413f-86cb-374700399b00 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:47.194720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8cc9486b-33b3-413f-86cb-374700399b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:47.323658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:47.367402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 144/270] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:47.382022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587d7e-2ba9-4630-a880-a7717d2778fd None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:47.394606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7250-9cbf-4000-9518-48e4a39f31a1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:47.394904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7250-9cbf-4000-9518-48e4a39f31a1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:47.395213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7250-9cbf-4000-9518-48e4a39f31a1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:47.397372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 145/271] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:47.409658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f6d6b-0225-4e34-942c-689739f4cbb0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:47.410282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f6d6b-0225-4e34-942c-689739f4cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:47.410855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f6d6b-0225-4e34-942c-689739f4cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:47.433061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-760f6d6b-0225-4e34-942c-689739f4cbb0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:47.438563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-760f6d6b-0225-4e34-942c-689739f4cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:47.456106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:47.457070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:47.457611 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:47.458095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:47.459096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] RBAC: Adding query filter params (role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=e9c4492e6e064c5c950593f929be3ce3) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:47.459614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:47.461477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:47.474150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 127/272] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:47 2022] GET /identity/v3/role_assignments?user.id=e9c4492e6e064c5c950593f929be3ce3&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:47.552455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 146/273] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:47.755308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:47.770660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:47.902292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64642858-01a5-40f2-8632-02c44edfa0b3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:47.970186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:47.971274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:47.971764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:47.972237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:47.974376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:47.976156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:47.978838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 128/274] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:47.985127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f6d6b-0225-4e34-942c-689739f4cbb0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:48.083671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:48.230094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f6d6b-0225-4e34-942c-689739f4cbb0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:48.257388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:48.261915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:48.288665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69f5c-0d7b-40d7-a44f-c04cd7e42cf6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:48.294748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:48.294748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:48.294748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:48.294748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:48.295343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:48.295343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:48.360227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c24a74-87af-4fb0-bbc1-983bd033d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:48.360923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24a74-87af-4fb0-bbc1-983bd033d92a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:48.361205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24a74-87af-4fb0-bbc1-983bd033d92a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:48.361482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24a74-87af-4fb0-bbc1-983bd033d92a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:48.376663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c24a74-87af-4fb0-bbc1-983bd033d92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-59c24a74-87af-4fb0-bbc1-983bd033d92a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:48.382958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:48.384186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 129/275] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:48.387633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a611b4-326e-4cde-9cc2-169503780c82 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:48.397825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a611b4-326e-4cde-9cc2-169503780c82 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:48.397825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a611b4-326e-4cde-9cc2-169503780c82 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:48.397825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 130/276] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:48.397825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ced5a-1eac-4cef-9153-c6f86a477ccb None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:48.397825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ced5a-1eac-4cef-9153-c6f86a477ccb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:48.397825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ced5a-1eac-4cef-9153-c6f86a477ccb None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:48.397825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 131/277] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:48.398637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ced5a-1eac-4cef-9153-c6f86a477ccb None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:48.538745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ced5a-1eac-4cef-9153-c6f86a477ccb None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:48.604180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577739ae-9320-499d-aad8-15375a59e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:48.605887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577739ae-9320-499d-aad8-15375a59e431 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:48.605887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577739ae-9320-499d-aad8-15375a59e431 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:48.606161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577739ae-9320-499d-aad8-15375a59e431 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:48.608432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577739ae-9320-499d-aad8-15375a59e431 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:48.608432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577739ae-9320-499d-aad8-15375a59e431 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:48.609850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577739ae-9320-499d-aad8-15375a59e431 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:48.623254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 132/278] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:48.625284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78638e21-c3ee-4e46-862b-058e999b8ff9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:48.626061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78638e21-c3ee-4e46-862b-058e999b8ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:48.626249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78638e21-c3ee-4e46-862b-058e999b8ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:48.653738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-78638e21-c3ee-4e46-862b-058e999b8ff9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:48.655109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-78638e21-c3ee-4e46-862b-058e999b8ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:48.684150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:48.765542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 133/279] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:48.767795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262964-de51-477a-9160-492c63ce13bf None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:48.768307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262964-de51-477a-9160-492c63ce13bf None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:48.768702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262964-de51-477a-9160-492c63ce13bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:48.795982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9f262964-de51-477a-9160-492c63ce13bf None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:48.797811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9f262964-de51-477a-9160-492c63ce13bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:48.815572 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 147/280] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 20:59:47 2022] POST /identity/v3/users => generated 293 bytes in 831 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 20:59:48.818632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:48.948223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 134/281] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:49.049410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579077b2-fa64-4ab3-b937-3596e284fedd None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:49.099259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262964-de51-477a-9160-492c63ce13bf None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:49.121741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:49.122645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:49.123117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:49.123697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] PATH_INFO: `/v3/users/b0793fb023c8468bbe28618090acbfae` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:49.156705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] RBAC: Authorizing `identity:get_user(user_id=b0793fb023c8468bbe28618090acbfae)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:49.158336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:49.162334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 148/282] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:48 2022] GET /identity/v3/users/b0793fb023c8468bbe28618090acbfae => generated 293 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:49.171860 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:49.220282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:49.223204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:49.309555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262964-de51-477a-9160-492c63ce13bf None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:49.348364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ec3d-0059-491b-95f3-f7b5775af6c0 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:49.388352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:49.389476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:49.389962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:49.390427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:49.411431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:49.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:49.424565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:49.426134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 135/283] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:49.428253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:49.443407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:49.444635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:49.445256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:49.445823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:49.447988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, user.id=b0793fb023c8468bbe28618090acbfae, scope.system=all) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:49.448618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:49.451538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:49.462605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 149/284] 10.222.0.71 () {56 vars in 1308 bytes} [Fri Sep 2 20:59:49 2022] GET /identity/v3/role_assignments?user.id=b0793fb023c8468bbe28618090acbfae&scope.system=all&role.id=2e8ee3364fce49668856661174d3b27d => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:49.465227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:49.644357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d857e-d606-4625-bfb4-b1e6b0c3d31b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:49.690966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:49.714667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:49.728291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8566-043b-476f-8a6d-df1ff8d405d3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:49.759337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:49.761551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:49.762028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:49.762500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:49.799879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:49.800666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:49.800991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:49.801254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:49.802101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] RBAC: Adding query filter params (name=member) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:49.802300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:49.804037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:49.806399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:49.811849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:49.813651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:49.815185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 136/285] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:49.825941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:49.830511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 150/286] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:49.842658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:50.172753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86689ec-f294-4a37-85e7-17588ce4e899 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:50.185137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3f4ab-141a-4ebc-b5be-1641aad81440 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:50.267555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:50.268675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:50.269525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:50.269993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:50.271038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:50.271531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:50.272423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:50.272943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:50.273356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] PATH_INFO: `/v3/users/fe88c279297e4c36a4ab2b75f9934fb9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:50.273829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:50.276775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:50.277948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] RBAC: Authorizing `identity:get_user(user_id=fe88c279297e4c36a4ab2b75f9934fb9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:50.280006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:50.291270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 151/287] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:49 2022] GET /identity/v3/users/fe88c279297e4c36a4ab2b75f9934fb9 => generated 297 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:50.292983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:50.300015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 137/288] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:50.310318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:50.354672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:50.385498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:50.506095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66294a09-cc3c-44f8-99a4-bade1306fe35 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:50.568809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287ce1b-6725-4daa-912c-50ee78b6bf5f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:50.582938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:50.583578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:50.584088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:50.584380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:50.635674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:50.636460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:50.636759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:50.637038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] PATH_INFO: `/v3/users/088fdf75e87e4cd591a1990118b28878` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:50.638425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] RBAC: Authorizing `identity:get_user(user_id=088fdf75e87e4cd591a1990118b28878)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:50.639940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:50.642569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 138/289] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:50 2022] GET /identity/v3/users/088fdf75e87e4cd591a1990118b28878 => generated 297 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:50.649885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:50.851879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:50.855257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:50.878241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea98d53-bb86-4793-8df4-6de2f72da02d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:50.909294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:50.948349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:50.954154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:50.955870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:50.956673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:50.957420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:50.959925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:50.964216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:50.967799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 139/290] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:50 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:50.980043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:51.114068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 152/291] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:51.122695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:51.191953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569ca3f-93d2-43e2-bc13-9d8736b8d9e5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:51.252838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:51.255178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:51.256265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:51.256928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/088fdf75e87e4cd591a1990118b28878/roles/0c27b4872908443092ac8932ff84b018` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:51.262661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1956032a34d4caa2f7a4aaea0bafe, user_id=088fdf75e87e4cd591a1990118b28878, role_id=0c27b4872908443092ac8932ff84b018)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:51.264660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:51.312699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c2f57-2ded-40d5-bfc4-d1fa65928111 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:51.342918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:51.360163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd4654-a162-42a5-a9a6-561418c9face None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:51.372845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd4654-a162-42a5-a9a6-561418c9face None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:51.373192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 140/292] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 20:59:50 2022] PUT /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/users/088fdf75e87e4cd591a1990118b28878/roles/0c27b4872908443092ac8932ff84b018 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:59:51.373547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd4654-a162-42a5-a9a6-561418c9face None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:51.374110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd4654-a162-42a5-a9a6-561418c9face None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:51.377759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd4654-a162-42a5-a9a6-561418c9face None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:51.379874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd4654-a162-42a5-a9a6-561418c9face None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:51.381976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 153/293] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:51 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:51.388718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:51.451557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:51.551133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247048-dac5-48e2-b0f2-c1e5648fa3f2 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:51.608460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3659a-ce70-49f8-9d71-e56cf6bc5bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:51.609440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3659a-ce70-49f8-9d71-e56cf6bc5bbc None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:51.609731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3659a-ce70-49f8-9d71-e56cf6bc5bbc None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:51.610066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3659a-ce70-49f8-9d71-e56cf6bc5bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:51.610918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3659a-ce70-49f8-9d71-e56cf6bc5bbc None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=fe88c279297e4c36a4ab2b75f9934fb9) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:51.611230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3659a-ce70-49f8-9d71-e56cf6bc5bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:51.612797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3659a-ce70-49f8-9d71-e56cf6bc5bbc None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:51.625190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 141/294] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:51 2022] GET /identity/v3/role_assignments?user.id=fe88c279297e4c36a4ab2b75f9934fb9&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=2e8ee3364fce49668856661174d3b27d => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:52.066536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888de25-a079-45d9-8ab6-f0a4352fc889 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.067051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888de25-a079-45d9-8ab6-f0a4352fc889 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.067504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888de25-a079-45d9-8ab6-f0a4352fc889 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.070698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 154/295] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:52.080776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85518e-ec60-4563-82b1-13198c34f478 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.080776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85518e-ec60-4563-82b1-13198c34f478 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.080776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85518e-ec60-4563-82b1-13198c34f478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.101277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bf85518e-ec60-4563-82b1-13198c34f478 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:52.102819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bf85518e-ec60-4563-82b1-13198c34f478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:52.193641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 142/296] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:52.294815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfe0d6-0033-4896-bcf7-cd0671c8de1d None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.295158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfe0d6-0033-4896-bcf7-cd0671c8de1d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.295360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfe0d6-0033-4896-bcf7-cd0671c8de1d None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.296777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 155/297] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:52.302528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eabf6c-c6e1-448b-914d-0f60b6463007 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.303131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eabf6c-c6e1-448b-914d-0f60b6463007 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.303636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eabf6c-c6e1-448b-914d-0f60b6463007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.329635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-23eabf6c-c6e1-448b-914d-0f60b6463007 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:52.330768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-23eabf6c-c6e1-448b-914d-0f60b6463007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:52.362125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:52.391334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb28fbc-f1ab-4d0b-88c2-b43587652ce5 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.391887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb28fbc-f1ab-4d0b-88c2-b43587652ce5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.392258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb28fbc-f1ab-4d0b-88c2-b43587652ce5 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.398109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 156/298] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:52.408336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2203e-08c4-43f0-b812-3f67c422d5ca None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.408631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2203e-08c4-43f0-b812-3f67c422d5ca None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.408918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2203e-08c4-43f0-b812-3f67c422d5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.427086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 143/299] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:52.434973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-82d2203e-08c4-43f0-b812-3f67c422d5ca None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:52.437270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-82d2203e-08c4-43f0-b812-3f67c422d5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:52.562285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 157/300] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 20:59:52.642415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eabf6c-c6e1-448b-914d-0f60b6463007 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:52.711677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2203e-08c4-43f0-b812-3f67c422d5ca None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:52.780812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eabf6c-c6e1-448b-914d-0f60b6463007 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:52.833120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:52.834148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.834663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.835176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.837359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:52.839542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:52.842335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 144/301] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:52.854162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:52.856304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2203e-08c4-43f0-b812-3f67c422d5ca None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:52.883433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:52.903596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:52.903835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:52.903835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:52.903835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:52.903835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:52.911175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:52.916984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:52.918106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:52.918908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 158/302] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:52.919577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:53.001922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b04d0-ec0b-45eb-804b-310a07d4f9f4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.056006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.056752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.057110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.057355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] PATH_INFO: `/v3/groups` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.057956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:53.059432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:53.081374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9279-e6ef-46b0-be9e-a0e7dc88d6f4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.129812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.130457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.130733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.131012 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.152785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 145/303] 10.222.0.71 () {60 vars in 1134 bytes} [Fri Sep 2 20:59:52 2022] POST /identity/v3/groups => generated 229 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 20:59:53.152785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:53.157611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:53.162578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:53.163533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:53.164581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 159/304] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:53.171222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:53.226992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:53.283578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:53.300387 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f978ce-323a-495e-aa2e-9cfabda8cffb None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.322904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f08072-a0c4-4345-a565-d3d3ccaa7161 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.351366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.352858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.353444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.354051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.354923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:53.355396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:53.358951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:53.371919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 146/305] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:53.388339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:53.402412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.404008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.404495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.405016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.406010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:53.406518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:53.408335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:53.420496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 160/306] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:53.430128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:53.544978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093c355-793f-4500-9377-8ba5569a635d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.585215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a5898-0687-4edb-b389-4e2f89af95a6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.589435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:53.591400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.592191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.592526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.592828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] PATH_INFO: `/v3/users/b0793fb023c8468bbe28618090acbfae` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.594147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] RBAC: Authorizing `identity:get_user(user_id=b0793fb023c8468bbe28618090acbfae)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:53.595687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:53.597491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 147/307] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:53 2022] GET /identity/v3/users/b0793fb023c8468bbe28618090acbfae => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:53.605827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:53.629561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.630589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.638199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.638199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] PATH_INFO: `/v3/users/ce80d7c783884a2e866b54b3b37cf2a9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.642400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:53.655947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] RBAC: Authorizing `identity:get_user(user_id=ce80d7c783884a2e866b54b3b37cf2a9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:53.658144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:53.659616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 161/308] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:53 2022] GET /identity/v3/users/ce80d7c783884a2e866b54b3b37cf2a9 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:53.665544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:53.777292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05af0-7fa6-4e3e-b9b9-107665d5ff63 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.826546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8436-b97c-42e8-a49f-b93f854e0cfc None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:53.847007 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73738ee-f9b5-4815-9109-386479f91648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.848753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73738ee-f9b5-4815-9109-386479f91648 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.849564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73738ee-f9b5-4815-9109-386479f91648 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.850328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73738ee-f9b5-4815-9109-386479f91648 None admin] PATH_INFO: `/v3/system/users/b0793fb023c8468bbe28618090acbfae/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.853559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73738ee-f9b5-4815-9109-386479f91648 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b0793fb023c8468bbe28618090acbfae, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:53.856489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73738ee-f9b5-4815-9109-386479f91648 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:53.894348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554616a8-b234-439a-ba97-b3155c2b3018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:53.895390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554616a8-b234-439a-ba97-b3155c2b3018 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:53.895936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554616a8-b234-439a-ba97-b3155c2b3018 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:53.896389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554616a8-b234-439a-ba97-b3155c2b3018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:53.897815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554616a8-b234-439a-ba97-b3155c2b3018 None admin] RBAC: Adding query filter params (role.id=0c27b4872908443092ac8932ff84b018, user.id=ce80d7c783884a2e866b54b3b37cf2a9, scope.system=all) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:53.899244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554616a8-b234-439a-ba97-b3155c2b3018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:53.900825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554616a8-b234-439a-ba97-b3155c2b3018 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:53.913173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 162/309] 10.222.0.71 () {56 vars in 1308 bytes} [Fri Sep 2 20:59:53 2022] GET /identity/v3/role_assignments?user.id=ce80d7c783884a2e866b54b3b37cf2a9&scope.system=all&role.id=0c27b4872908443092ac8932ff84b018 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:53.981407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 148/310] 10.222.0.71 () {58 vars in 1334 bytes} [Fri Sep 2 20:59:53 2022] PUT /identity/v3/system/users/b0793fb023c8468bbe28618090acbfae/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 20:59:54.111204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a913-2a11-4d9c-9463-b02e60a63b02 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:54.111617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a913-2a11-4d9c-9463-b02e60a63b02 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:54.111881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a913-2a11-4d9c-9463-b02e60a63b02 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:54.113331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 163/311] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:54.121298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fb84-12bb-42e0-891a-95beea0759ea None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:54.121976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fb84-12bb-42e0-891a-95beea0759ea None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:54.122463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29fb84-12bb-42e0-891a-95beea0759ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:54.147362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8d29fb84-12bb-42e0-891a-95beea0759ea None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:54.149344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8d29fb84-12bb-42e0-891a-95beea0759ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:54.249841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 149/312] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:54.541618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a913-2a11-4d9c-9463-b02e60a63b02 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:54.580687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:54.682330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a913-2a11-4d9c-9463-b02e60a63b02 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:54.730224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:54.731141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:54.731431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:54.731704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:54.747754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:54.752902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:54.754363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:54.756392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 164/313] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:54.762437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fb84-12bb-42e0-891a-95beea0759ea None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:54.781602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:54.932174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29fb84-12bb-42e0-891a-95beea0759ea None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:54.978800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:54.979412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:54.979705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:54.979996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:54.980691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:54.981029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:54.982679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:54.993528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 150/314] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:54.999578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:55.158356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:55.176974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b370fe-6d59-4ca9-9ab9-40529c0f1ae6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:55.246261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:55.247372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:55.247863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:55.248350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] PATH_INFO: `/v3/users/088fdf75e87e4cd591a1990118b28878` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:55.250630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] RBAC: Authorizing `identity:get_user(user_id=088fdf75e87e4cd591a1990118b28878)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:55.253738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:55.256960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 165/315] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:54 2022] GET /identity/v3/users/088fdf75e87e4cd591a1990118b28878 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:55.263984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:55.409336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:55.433989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82ff04-469f-4d34-9356-6cb83f66c04a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:55.474241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b996ad9-1ead-4d24-aebf-c3bf7ac6d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:55.474909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996ad9-1ead-4d24-aebf-c3bf7ac6d1e8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:55.475369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996ad9-1ead-4d24-aebf-c3bf7ac6d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:55.475839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996ad9-1ead-4d24-aebf-c3bf7ac6d1e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:55.597151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b996ad9-1ead-4d24-aebf-c3bf7ac6d1e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:55.599807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b996ad9-1ead-4d24-aebf-c3bf7ac6d1e8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:55.734331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:55.765333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 151/316] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 20:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 20:59:55.774568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:55.836142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc036-290c-4007-8e15-dc101a41657a None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:55.836624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc036-290c-4007-8e15-dc101a41657a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:55.837151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc036-290c-4007-8e15-dc101a41657a None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:55.840394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 152/317] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 20:59:55.849682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8183-23ed-4858-a24b-4bc6c626c074 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:55.850053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8183-23ed-4858-a24b-4bc6c626c074 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:55.850547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8183-23ed-4858-a24b-4bc6c626c074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:55.884437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-fb8a8183-23ed-4858-a24b-4bc6c626c074 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:55.886886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fb8a8183-23ed-4858-a24b-4bc6c626c074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:55.910430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e0dd-d013-4cb2-9a07-c1048258978b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:55.986369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:55.987167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:55.987855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:55.988385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:55.990891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:55.994902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:56.005264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 166/318] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 20:59:55 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:56.012780 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:56.029720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 153/319] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:56.068175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:56.229054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dfe8f-67a0-4682-87fc-7af4ac907a2b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:56.298529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa49229-7b62-4961-b04c-48e290dd271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:56.299523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49229-7b62-4961-b04c-48e290dd271c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:56.300012 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49229-7b62-4961-b04c-48e290dd271c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:56.300495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49229-7b62-4961-b04c-48e290dd271c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:56.301897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49229-7b62-4961-b04c-48e290dd271c None admin] RBAC: Adding query filter params (role.id=0c27b4872908443092ac8932ff84b018, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe, user.id=088fdf75e87e4cd591a1990118b28878) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:56.302446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49229-7b62-4961-b04c-48e290dd271c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:56.305254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49229-7b62-4961-b04c-48e290dd271c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:56.317178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 167/320] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 20:59:56 2022] GET /identity/v3/role_assignments?user.id=088fdf75e87e4cd591a1990118b28878&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=0c27b4872908443092ac8932ff84b018 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:56.325478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0544-e2b7-4c08-a8f1-57e982000e89 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:56.326489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0544-e2b7-4c08-a8f1-57e982000e89 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:56.326988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0544-e2b7-4c08-a8f1-57e982000e89 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:56.333359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 154/321] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:56.335377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f555-41a4-4287-b645-ff6cb333f981 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:56.335838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f555-41a4-4287-b645-ff6cb333f981 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:56.336310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87f555-41a4-4287-b645-ff6cb333f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:56.360324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-be87f555-41a4-4287-b645-ff6cb333f981 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:56.362263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-be87f555-41a4-4287-b645-ff6cb333f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:56.486508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 168/322] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:56.495762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0544-e2b7-4c08-a8f1-57e982000e89 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:56.590710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4febd-8f30-4af3-9a42-72dba10d4551 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:56.591043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4febd-8f30-4af3-9a42-72dba10d4551 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:56.591291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4febd-8f30-4af3-9a42-72dba10d4551 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:56.592721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 169/323] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 20:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 20:59:56.599000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a3b0-7fa3-49e3-91e9-a616f92ea132 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:56.601201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a3b0-7fa3-49e3-91e9-a616f92ea132 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:56.601201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a3b0-7fa3-49e3-91e9-a616f92ea132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:56.628561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1b35a3b0-7fa3-49e3-91e9-a616f92ea132 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 20:59:56.629837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1b35a3b0-7fa3-49e3-91e9-a616f92ea132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 20:59:56.645440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:56.674392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0544-e2b7-4c08-a8f1-57e982000e89 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:56.680722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:56.740008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:56.740841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:56.741251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:56.741655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:56.743249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:56.745726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:56.747972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 155/324] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 20:59:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:56.756695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:56.777644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 170/325] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 20:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 20:59:56.779815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a3b0-7fa3-49e3-91e9-a616f92ea132 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:56.987101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a3b0-7fa3-49e3-91e9-a616f92ea132 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:56.987746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79932c1a-83c7-4199-be7c-729ed7c82fb7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:57.063300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:57.064299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:57.064609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:57.065099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] PATH_INFO: `/v3/groups` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:57.066277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:57.066986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:57.067879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:57.068347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:57.068889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:57.069043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:57.089430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:57.094545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:57.097739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 20:59:57.099339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 171/326] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:57.102351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:57.114525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:57.210154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 156/327] 10.222.0.71 () {60 vars in 1134 bytes} [Fri Sep 2 20:59:56 2022] POST /identity/v3/groups => generated 226 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 20:59:57.211243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:57.276301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:57.284393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9731bc5-2712-4e46-8e05-be209f6e5116 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:57.354610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:57.355176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:57.356389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:57.356699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:57.357980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:57.358464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:57.360908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:57.373736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 172/328] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:57.380532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:57.407407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2df06-3576-4b5e-8bfd-38813ec2e080 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:57.479503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:57.480883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:57.481347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:57.481774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:57.505201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 20:59:57.516125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 20:59:57.517444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 20:59:57.518914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 157/329] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 20:59:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 20:59:57.527959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:57.532028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:57.589329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641e75c-29fe-4391-ba16-2cce3460387e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:57.674818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:57.674818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:57.675079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:57.675549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] PATH_INFO: `/v3/users/ce80d7c783884a2e866b54b3b37cf2a9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:57.679590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] RBAC: Authorizing `identity:get_user(user_id=ce80d7c783884a2e866b54b3b37cf2a9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:57.681556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:57.688764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 173/330] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:57 2022] GET /identity/v3/users/ce80d7c783884a2e866b54b3b37cf2a9 => generated 293 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 20:59:57.694434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:57.758075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:57.782215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95e591-16d4-4d1a-8a47-7977ec3a8b87 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:57.866920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:57.868064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:57.868518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:57.869087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:57.870714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:57.871225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:57.872762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:57.886653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 158/331] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 20:59:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:57.897090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:57.929932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1114-5606-4ea3-a645-e54a711f7364 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:57.994975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:57.996329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:57.996837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:57.997208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] PATH_INFO: `/v3/system/users/ce80d7c783884a2e866b54b3b37cf2a9/roles/0c27b4872908443092ac8932ff84b018` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:57.998833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ce80d7c783884a2e866b54b3b37cf2a9, role_id=0c27b4872908443092ac8932ff84b018)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:58.000256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:58.005405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 20:59:58.149703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87a870-d36c-4dce-a40e-37689b2d57b9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:58.170242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 174/332] 10.222.0.71 () {58 vars in 1334 bytes} [Fri Sep 2 20:59:57 2022] PUT /identity/v3/system/users/ce80d7c783884a2e866b54b3b37cf2a9/roles/0c27b4872908443092ac8932ff84b018 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 20:59:58.208827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ad629-d85b-430e-971c-26077277baf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:58.209870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ad629-d85b-430e-971c-26077277baf8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:58.210349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ad629-d85b-430e-971c-26077277baf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:58.210871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ad629-d85b-430e-971c-26077277baf8 None admin] PATH_INFO: `/v3/users/b0793fb023c8468bbe28618090acbfae` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:58.213156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ad629-d85b-430e-971c-26077277baf8 None admin] RBAC: Authorizing `identity:get_user(user_id=b0793fb023c8468bbe28618090acbfae)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:58.215069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ad629-d85b-430e-971c-26077277baf8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:58.220881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 159/333] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 20:59:57 2022] GET /identity/v3/users/b0793fb023c8468bbe28618090acbfae => generated 293 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 20:59:58.224307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 20:59:58.459865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e71e-1951-469c-8ef0-d2d522f39b4b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 20:59:58.544495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3753c59-1927-495d-9e63-05a7f37198f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 20:59:58.549154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753c59-1927-495d-9e63-05a7f37198f4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 20:59:58.549154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753c59-1927-495d-9e63-05a7f37198f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 20:59:58.549154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753c59-1927-495d-9e63-05a7f37198f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 20:59:58.549154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753c59-1927-495d-9e63-05a7f37198f4 None admin] RBAC: Adding query filter params (role.id=2e8ee3364fce49668856661174d3b27d, user.id=b0793fb023c8468bbe28618090acbfae, scope.system=all) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 20:59:58.550119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753c59-1927-495d-9e63-05a7f37198f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 20:59:58.553388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753c59-1927-495d-9e63-05a7f37198f4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 20:59:58.582193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 175/334] 10.222.0.71 () {56 vars in 1308 bytes} [Fri Sep 2 20:59:58 2022] GET /identity/v3/role_assignments?user.id=b0793fb023c8468bbe28618090acbfae&scope.system=all&role.id=2e8ee3364fce49668856661174d3b27d => generated 510 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:01.473276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4f0c-1ac3-4d16-af1d-94823fb3c210 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:01.474899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4f0c-1ac3-4d16-af1d-94823fb3c210 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:01.475663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc4f0c-1ac3-4d16-af1d-94823fb3c210 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:01.479110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 160/335] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:01.499159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587da70c-932c-4b8e-9df5-4e0e9bb36f7d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:01.500897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587da70c-932c-4b8e-9df5-4e0e9bb36f7d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:01.501676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587da70c-932c-4b8e-9df5-4e0e9bb36f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:01.546530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-587da70c-932c-4b8e-9df5-4e0e9bb36f7d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:01.549256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-587da70c-932c-4b8e-9df5-4e0e9bb36f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:01.673711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:01.708165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 176/336] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:01.821979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053c19-27c5-4624-8bcc-d608afb78c64 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:01.822455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053c19-27c5-4624-8bcc-d608afb78c64 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:01.823256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053c19-27c5-4624-8bcc-d608afb78c64 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:01.826517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 161/337] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:01.833767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633d86-6258-4769-87e0-60c5dae4a0e4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:01.834259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633d86-6258-4769-87e0-60c5dae4a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:01.834731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633d86-6258-4769-87e0-60c5dae4a0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:01.886981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-90633d86-6258-4769-87e0-60c5dae4a0e4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:01.889138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-90633d86-6258-4769-87e0-60c5dae4a0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:02.063451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 177/338] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:02.703896 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053c19-27c5-4624-8bcc-d608afb78c64 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:02.765775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:02.892159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4d42-fc3f-440b-92c6-494f7ebc258b None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:02.892978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4d42-fc3f-440b-92c6-494f7ebc258b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:02.897494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4d42-fc3f-440b-92c6-494f7ebc258b None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:02.900800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 178/339] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:02.911319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49ac3-df49-4a70-9570-593ebf604e9a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:02.911821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49ac3-df49-4a70-9570-593ebf604e9a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:02.912313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49ac3-df49-4a70-9570-593ebf604e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:02.957078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053c19-27c5-4624-8bcc-d608afb78c64 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:02.974829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b4c49ac3-df49-4a70-9570-593ebf604e9a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:02.985393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b4c49ac3-df49-4a70-9570-593ebf604e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:03.035850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:03.037015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.037760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.038450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.061693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:03.072509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:03.074665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:03.076416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:03.080110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 162/340] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:03.082094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:03.252126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 179/341] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:03.254342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49ac3-df49-4a70-9570-593ebf604e9a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:03.310200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:03.353806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:03.367030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5837-da13-4a58-b0b8-bb51e6ee38d8 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:03.452180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49ac3-df49-4a70-9570-593ebf604e9a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:03.484367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22279cd4-53e1-41df-adbc-886314717c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:03.485734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279cd4-53e1-41df-adbc-886314717c5a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.486604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279cd4-53e1-41df-adbc-886314717c5a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.487458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279cd4-53e1-41df-adbc-886314717c5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.518524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22279cd4-53e1-41df-adbc-886314717c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-22279cd4-53e1-41df-adbc-886314717c5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:03.530701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:03.532282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:03.534260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:03.535507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139440-4e79-447f-b0f2-207a88605671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:03.536161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139440-4e79-447f-b0f2-207a88605671 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.536408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139440-4e79-447f-b0f2-207a88605671 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.536648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139440-4e79-447f-b0f2-207a88605671 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.537813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139440-4e79-447f-b0f2-207a88605671 None admin] RBAC: Adding query filter params (name=member) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:03.538341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139440-4e79-447f-b0f2-207a88605671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:03.540896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139440-4e79-447f-b0f2-207a88605671 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:03.541303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 163/342] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:00:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:03.562544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c068cb-c1b8-4986-be52-ddd3f9033998 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.562544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c068cb-c1b8-4986-be52-ddd3f9033998 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.562544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c068cb-c1b8-4986-be52-ddd3f9033998 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.562544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 164/343] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:03.562544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c068cb-c1b8-4986-be52-ddd3f9033998 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:03.566638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 180/344] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:03.568576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a813188-03a3-4077-8171-c4adc6927262 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.569115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a813188-03a3-4077-8171-c4adc6927262 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.569630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a813188-03a3-4077-8171-c4adc6927262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.600560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2a813188-03a3-4077-8171-c4adc6927262 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:03.602270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2a813188-03a3-4077-8171-c4adc6927262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:03.718441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 181/345] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:03.723459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a813188-03a3-4077-8171-c4adc6927262 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:03.813003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c068cb-c1b8-4986-be52-ddd3f9033998 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:03.829367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:03.885364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54505cbf-9924-484e-ab68-59ff7cf294b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:03.887312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505cbf-9924-484e-ab68-59ff7cf294b7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.888288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505cbf-9924-484e-ab68-59ff7cf294b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.889189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505cbf-9924-484e-ab68-59ff7cf294b7 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.890145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505cbf-9924-484e-ab68-59ff7cf294b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:03.890733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505cbf-9924-484e-ab68-59ff7cf294b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:03.892540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505cbf-9924-484e-ab68-59ff7cf294b7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:03.906327 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 165/346] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:03.911073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853a13-40c1-4dd0-9593-a8aa3c8d3bf5 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.912029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853a13-40c1-4dd0-9593-a8aa3c8d3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.912720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853a13-40c1-4dd0-9593-a8aa3c8d3bf5 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.916706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 166/347] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:03.929918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7683b-52b1-4403-9783-573dc428870b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:03.931126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7683b-52b1-4403-9783-573dc428870b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:03.932034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7683b-52b1-4403-9783-573dc428870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:03.948157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a813188-03a3-4077-8171-c4adc6927262 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:03.951518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:03.976157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-d1c7683b-52b1-4403-9783-573dc428870b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:03.979747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d1c7683b-52b1-4403-9783-573dc428870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:04.010204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:04.011276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:04.011732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:04.012146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:04.109511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 167/348] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:04.111699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7683b-52b1-4403-9783-573dc428870b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:04.170005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:04.177154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:04.262447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:04.364989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7683b-52b1-4403-9783-573dc428870b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:04.411686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 182/349] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:04.413943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:04.477857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:04.478790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:04.479394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:04.479759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:04.486932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:04.624903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:04.627748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:04.644027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e1a56-b93c-4ecf-8db2-f05181055041 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:04.691750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:04.692920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:04.693344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:04.693764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:04.708401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:04.715763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:04.728307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:04.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:00:04.730377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:04.733338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 183/350] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:04.735235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:04.853243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 168/351] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:04.854780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:04.934205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:04.945455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfd76b-43af-4d73-a0fb-1d367c90f448 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:05.029130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:05.029130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.029130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.029130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.031221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:05.033236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:05.036481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 184/352] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:04 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:05.038182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:05.083034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b536-e4ce-4c49-936b-31f0e9c0c3c6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:05.158727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed8c70-672c-432a-acaa-d2e42e87439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:05.159778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8c70-672c-432a-acaa-d2e42e87439c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.160250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8c70-672c-432a-acaa-d2e42e87439c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.160752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8c70-672c-432a-acaa-d2e42e87439c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.185260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:05.186992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed8c70-672c-432a-acaa-d2e42e87439c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-76ed8c70-672c-432a-acaa-d2e42e87439c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:05.195689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:05.215409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 169/353] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:05.217878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c345-dcc0-481f-91a8-62421874edd8 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.218996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c345-dcc0-481f-91a8-62421874edd8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.218996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c345-dcc0-481f-91a8-62421874edd8 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.218996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 170/354] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:05.218996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132c345-dcc0-481f-91a8-62421874edd8 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:05.250469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43222db-6510-4950-b75c-dfebee2b1dd4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:05.323166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:05.324218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.324684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.325189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.326347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:05.326823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:05.330482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:05.349833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 185/355] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:00:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:05.357649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:05.421192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:05.434482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132c345-dcc0-481f-91a8-62421874edd8 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:05.506766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:05.508155 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.510848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.511409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.537203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:05.548234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:05.549961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:05.551434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 171/356] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:00:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:05.552686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:05.574408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd43d-04d2-4950-92e7-a7f012c5a616 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:05.638093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:05.647986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:05.649064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.649573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.651209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.656920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:05.656920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:05.657862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 186/357] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:05 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:05.658905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:05.773720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb732288-022a-45ae-81ee-62d7fdcf4a65 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:05.849491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6a49e-51a8-4c60-864d-6e2c111ea34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:05.850216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6a49e-51a8-4c60-864d-6e2c111ea34d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.850688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6a49e-51a8-4c60-864d-6e2c111ea34d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.851156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6a49e-51a8-4c60-864d-6e2c111ea34d None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.866345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6a49e-51a8-4c60-864d-6e2c111ea34d None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:05.869623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6a49e-51a8-4c60-864d-6e2c111ea34d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:05.876809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 172/358] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:05 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:05.876809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdaa65-2d1d-4f19-b5d6-5f3c83fb3c09 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.876809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdaa65-2d1d-4f19-b5d6-5f3c83fb3c09 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.876809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdaa65-2d1d-4f19-b5d6-5f3c83fb3c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.901159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e4c51-1156-41db-bb51-81deeb85fbbe None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:05.914276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-d1cdaa65-2d1d-4f19-b5d6-5f3c83fb3c09 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:05.916978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d1cdaa65-2d1d-4f19-b5d6-5f3c83fb3c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:05.946036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:05.964348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:05.965254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:05.965658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:05.966583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:05.968475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] RBAC: Adding query filter params (name=member) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:05.968475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:05.972841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:05.987827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 187/359] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:05.991820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:06.077856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 173/360] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:06.078702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdaa65-2d1d-4f19-b5d6-5f3c83fb3c09 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:06.125452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:06.240805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37bbf8-f2b8-45a9-ae9e-64898bdb97da None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:06.307087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdaa65-2d1d-4f19-b5d6-5f3c83fb3c09 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:06.335906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:06.337188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:06.337948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:06.338537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] PATH_INFO: `/v3/users/ce80d7c783884a2e866b54b3b37cf2a9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:06.341301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ce80d7c783884a2e866b54b3b37cf2a9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:06.344348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:06.350457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 188/361] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:00:05 2022] GET /identity/v3/users/ce80d7c783884a2e866b54b3b37cf2a9 => generated 293 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:06.350951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:06.402939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:06.404265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:06.410593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:06.410593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:06.410593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:06.410593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:06.411389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:06.431081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 174/362] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:06.432508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:06.466092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:06.583521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6b24-05dd-4ce3-b7a9-c83dc567d8f2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:06.638422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:06.650543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aa710-d1c3-45d0-b8ca-a207cb8fc2e0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:06.653123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:06.654222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:06.654718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:06.655212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:06.657411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:06.660178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:06.663290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 189/363] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:06 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:06.665006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:06.736428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:06.737531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:06.738025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:06.738522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:06.740149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=7b439539190246dab7b521b2ea009f17) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:06.740703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:06.744063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:06.757006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 175/364] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:06 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=2e8ee3364fce49668856661174d3b27d => generated 260 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:06.758325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:06.874093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f27531-9eb0-466d-8c16-dc691efe9687 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:06.933428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:06.945367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:06.950911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:06.950911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:06.950911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:06.993119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865fbc-ab44-47a2-8a61-dcc2678c8396 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:07.066227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:07.067269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:07.067731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:07.068202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:07.069685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] RBAC: Adding query filter params (role.id=0c27b4872908443092ac8932ff84b018, user.id=ce80d7c783884a2e866b54b3b37cf2a9, scope.system=all) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:07.070228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:07.071763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:07.073072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:07.085530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:07.088485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:07.108788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 176/365] 10.222.0.71 () {56 vars in 1308 bytes} [Fri Sep 2 21:00:06 2022] GET /identity/v3/role_assignments?user.id=ce80d7c783884a2e866b54b3b37cf2a9&scope.system=all&role.id=0c27b4872908443092ac8932ff84b018 => generated 510 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:07.108788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:07.345422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 190/366] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:07.348117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:07.391248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bb68-1080-4d3b-9426-128f691fc1bc None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:07.463861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:07.477981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:07.479486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:07.480214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:07.481831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:07.590922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:07.606383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312dc86-eb90-42e9-86f9-61fc0a1a858a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:07.630579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:07.633825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:07.689020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:07.690025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:07.690308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:07.690580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:07.708368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:07.723103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:07.724854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 191/367] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:07.730352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:07.908119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 177/368] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:07.909697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:07.957113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510056e1-1de2-42e9-8713-06514343bcb6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:07.990323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:08.044097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:08.045202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:08.045942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:08.046377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:08.047781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=7b439539190246dab7b521b2ea009f17) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:08.048349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:08.051178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:08.062946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 192/369] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:07 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 260 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:08.064462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:08.129527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:08.156048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e37f7-b122-4de9-ac0f-3ac63ac14e25 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:08.236344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:08.237639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:08.238343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:08.239030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:08.243066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:08.246303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:08.249826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 178/370] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:07 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:08.252104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:08.322478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271ebf-2eb0-4d85-af57-12aeead9fdf1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:08.413140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:08.416400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:08.417499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:08.418276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:08.419850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:08.420787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:08.423702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:08.451297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 193/371] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:08.453397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:08.500770 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:08.506405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297cdc-7eaa-4792-a3a4-85e96b0c48f6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:08.595033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:08.596316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:08.596848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:08.597341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:08.599497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:08.602954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:08.612775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 179/372] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:08 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:08.612775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:08.659160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:08.708257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bf140-1585-44a1-a4e2-823679c6bd1d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:08.791443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:08.796111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:08.796766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:08.797076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:08.798800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:08.800910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:08.808997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 194/373] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:08 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:08.808997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:08.939499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3926c-78be-4942-95e7-ad53761cee76 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:09.027376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:09.028512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:09.029117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:09.029685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:09.107769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945bf2a-06ce-48b1-a575-3f9dbd9e380a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:09.111049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:09.194634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:09.198149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:09.198413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:09.199767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:09.200534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:09.201479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:09.205781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:09.209055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:09.220799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 195/374] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:08 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:09.220799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:09.257121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:09.442694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d967d-f5aa-4ff9-902f-a900e629dae7 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:09.444202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 180/375] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:09.445803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:09.517978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:09.519600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:09.520433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:09.521233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:09.523061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:09.523961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:09.527248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:09.544220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 196/376] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:09 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=2e8ee3364fce49668856661174d3b27d => generated 260 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:09.548597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:09.590582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:09.668828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab389c-94ed-45ec-baa8-3e1a40418b75 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:09.776805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:09.776805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:09.776805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:09.776805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:09.777462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:09.777462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:09.785363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:09.801475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:09.819697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 181/377] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:09 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 260 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:09.860463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61207f86-351e-4328-86b3-b02c5cb0a2cb None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:09.936319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab61fa1-c44c-4f85-8daf-c1762a5e8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:09.937421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab61fa1-c44c-4f85-8daf-c1762a5e8ec6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:09.937916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab61fa1-c44c-4f85-8daf-c1762a5e8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:09.938394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab61fa1-c44c-4f85-8daf-c1762a5e8ec6 None admin] PATH_INFO: `/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:09.940570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab61fa1-c44c-4f85-8daf-c1762a5e8ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=ed07aa8a11c5411cab1c62d6e9841ea5)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:09.943362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab61fa1-c44c-4f85-8daf-c1762a5e8ec6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:09.947736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 197/378] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:09 2022] GET /identity/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5 => generated 344 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:09.957587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:10.239626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5701-9669-4f0c-a4e1-d182a24b502d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:10.242111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb1fc-a9f4-49f0-82f6-6e8db6434726 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:10.242437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb1fc-a9f4-49f0-82f6-6e8db6434726 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:10.242753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eb1fc-a9f4-49f0-82f6-6e8db6434726 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:10.251952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 198/379] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:10.254309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4ed60-a064-4ca8-9637-384cbd52daaa None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:10.254592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4ed60-a064-4ca8-9637-384cbd52daaa None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:10.254867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4ed60-a064-4ca8-9637-384cbd52daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:10.283751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-dca4ed60-a064-4ca8-9637-384cbd52daaa None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:10.285870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-dca4ed60-a064-4ca8-9637-384cbd52daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:10.321804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:10.350422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:10.350422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:10.350422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:10.350422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] PATH_INFO: `/v3/groups/1c7e4109c3454898b8ff774965689b5c` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:10.360156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] RBAC: Authorizing `identity:get_group(group_id=1c7e4109c3454898b8ff774965689b5c)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:10.362957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:10.374870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 182/380] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:09 2022] GET /identity/v3/groups/1c7e4109c3454898b8ff774965689b5c => generated 229 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:10.379767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:10.424486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 199/381] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:10.591082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78232e98-8b51-4521-aa36-23ebc11a80e1 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:10.666838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:10.667879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:10.668777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:10.669256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:10.670634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] RBAC: Adding query filter params (group.id=1c7e4109c3454898b8ff774965689b5c, role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=ed07aa8a11c5411cab1c62d6e9841ea5) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:10.671176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:10.673901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:10.689889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 183/382] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:10 2022] GET /identity/v3/role_assignments?group.id=1c7e4109c3454898b8ff774965689b5c&scope.project.id=ed07aa8a11c5411cab1c62d6e9841ea5&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:11.030106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4ed60-a064-4ca8-9637-384cbd52daaa None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:11.197404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:11.236487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4ed60-a064-4ca8-9637-384cbd52daaa None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:11.307204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:11.308175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:11.308677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:11.309168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:11.330725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:11.341194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:11.342933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:11.344488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 200/383] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:11.359467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:11.524494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:11.626465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65e983-5ef3-4574-9c83-711d79a09965 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:11.708033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a94b1d-5faa-4b8d-8856-da4282ab08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:11.709540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a94b1d-5faa-4b8d-8856-da4282ab08ee None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:11.710301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a94b1d-5faa-4b8d-8856-da4282ab08ee None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:11.711023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a94b1d-5faa-4b8d-8856-da4282ab08ee None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:11.712436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a94b1d-5faa-4b8d-8856-da4282ab08ee None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:11.713267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a94b1d-5faa-4b8d-8856-da4282ab08ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:11.716236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a94b1d-5faa-4b8d-8856-da4282ab08ee None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:11.744336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 184/384] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:00:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:11.754457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:12.019043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853bf10-f637-461c-95f4-d148db4a5764 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:12.019043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853bf10-f637-461c-95f4-d148db4a5764 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:12.020957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853bf10-f637-461c-95f4-d148db4a5764 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:12.022683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 185/385] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:00:12.031746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dbae0-7f79-4527-a56e-1ef20d1163cc None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:12.032240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dbae0-7f79-4527-a56e-1ef20d1163cc None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:12.032609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dbae0-7f79-4527-a56e-1ef20d1163cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:12.091288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3dc38-307b-482d-ae38-9aa3aecd22a2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:12.094679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c25dbae0-7f79-4527-a56e-1ef20d1163cc None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:12.097119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c25dbae0-7f79-4527-a56e-1ef20d1163cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:12.196912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:12.198705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:12.200285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:12.201169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:12.204326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:12.209013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:12.214648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 201/386] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:11 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:12.228672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:12.256256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:12.377506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 186/387] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:12.478427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a56b-f0a9-44b2-8506-c11fdc3920c2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:12.552428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142743-e557-47dd-8318-105151955a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:12.553508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142743-e557-47dd-8318-105151955a7f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:12.553991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142743-e557-47dd-8318-105151955a7f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:12.554473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee142743-e557-47dd-8318-105151955a7f None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:12.556811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee142743-e557-47dd-8318-105151955a7f None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:12.559647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee142743-e557-47dd-8318-105151955a7f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:12.563278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 202/388] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:12 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:12.573995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dbae0-7f79-4527-a56e-1ef20d1163cc None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:12.705328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:12.843797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dbae0-7f79-4527-a56e-1ef20d1163cc None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:12.931880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:12.933023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:12.933502 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:12.934036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:12.937523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b439539190246dab7b521b2ea009f17, group_id=b7dad8aaff2d43aea7cf9a36ddca40b9, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:12.940367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:13.017982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142743-e557-47dd-8318-105151955a7f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:13.054832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 187/389] 10.222.0.71 () {58 vars in 1442 bytes} [Fri Sep 2 21:00:12 2022] PUT /identity/v3/projects/7b439539190246dab7b521b2ea009f17/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:00:13.193042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:13.242807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee142743-e557-47dd-8318-105151955a7f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:13.334258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f29923-be0b-43ee-a6a4-63fa09769bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:13.335250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29923-be0b-43ee-a6a4-63fa09769bd0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:13.335739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29923-be0b-43ee-a6a4-63fa09769bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:13.336230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29923-be0b-43ee-a6a4-63fa09769bd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:13.363192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f29923-be0b-43ee-a6a4-63fa09769bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c2f29923-be0b-43ee-a6a4-63fa09769bd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:13.378021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:13.380052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:13.381710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 203/390] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:00:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:13.389792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:13.620670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c85-87d7-413c-b55f-429dd963ed4a None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:13.621501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c85-87d7-413c-b55f-429dd963ed4a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:13.622211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c85-87d7-413c-b55f-429dd963ed4a None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:13.626964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 204/391] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:13 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:13.641730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67d691-4b83-44cf-a650-545aa5d56e45 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:13.642658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67d691-4b83-44cf-a650-545aa5d56e45 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:13.643450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67d691-4b83-44cf-a650-545aa5d56e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:13.681665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7c67d691-4b83-44cf-a650-545aa5d56e45 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:13.683830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7c67d691-4b83-44cf-a650-545aa5d56e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:13.690517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f5b0-9c3a-4c29-9c32-57b551bec531 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:13.741167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:13.843302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:13.844360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:13.844916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:13.845421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:13.846775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:13.847332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:13.850061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:13.881429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 188/392] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:13.893771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:13.981210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 205/393] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:14.127726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f5b2-ca43-46c3-9b5c-d674499ed4a3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:14.130070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0cf85-c38f-43e5-8db5-4d965ecb158e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:14.130855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0cf85-c38f-43e5-8db5-4d965ecb158e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:14.131672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0cf85-c38f-43e5-8db5-4d965ecb158e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:14.141323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 206/394] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:14.151605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffdb7-ea59-4a30-acfd-b2f106fb9311 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:14.152295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffdb7-ea59-4a30-acfd-b2f106fb9311 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:14.153003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffdb7-ea59-4a30-acfd-b2f106fb9311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:14.193993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:14.194940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:14.195409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:14.195892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:14.202511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:14.202511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:14.205112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 189/395] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:13 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:14.215853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:14.237932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-fefffdb7-ea59-4a30-acfd-b2f106fb9311 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:14.240053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-fefffdb7-ea59-4a30-acfd-b2f106fb9311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:14.308523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:14.437200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4c8fc-cf4a-4768-8103-caaecfa90721 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:14.472365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:14.498377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 207/396] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:14.528163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:14.529309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:14.529870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:14.530488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:14.533103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:14.536195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:14.539108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 190/397] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:14 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:14.548974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffdb7-ea59-4a30-acfd-b2f106fb9311 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:14.770485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffdb7-ea59-4a30-acfd-b2f106fb9311 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:14.791753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:14.848210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:14.849383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:14.849855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:14.850318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:14.860356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b439539190246dab7b521b2ea009f17, group_id=b7dad8aaff2d43aea7cf9a36ddca40b9, role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:14.863273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:14.993137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 208/398] 10.222.0.71 () {58 vars in 1442 bytes} [Fri Sep 2 21:00:14 2022] PUT /identity/v3/projects/7b439539190246dab7b521b2ea009f17/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:00:15.111283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3bc1a-f181-4490-ab5b-869020a02ca0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:15.142689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:15.197816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:15.219574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:15.220760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:15.221220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:15.221704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:15.271683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:15.282470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:15.284060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:15.285463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:15.290793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 191/399] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:15.300670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:15.450067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:15.623766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622880-4669-41ee-9688-df962a4c2b79 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:15.663458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3b8d9-4d8b-4357-8b16-346a7a53fa4d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:15.738219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc6008-b911-4037-ac5e-9c42f6ee0bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:15.739583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc6008-b911-4037-ac5e-9c42f6ee0bce None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:15.740252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc6008-b911-4037-ac5e-9c42f6ee0bce None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:15.740993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc6008-b911-4037-ac5e-9c42f6ee0bce None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:15.743262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc6008-b911-4037-ac5e-9c42f6ee0bce None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:15.744375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc6008-b911-4037-ac5e-9c42f6ee0bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:15.747095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc6008-b911-4037-ac5e-9c42f6ee0bce None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:15.750425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:15.755882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:15.759131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:15.761099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:15.764572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 192/400] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:00:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:15.767378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a806-6d3d-4300-82b1-0438a8211864 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:15.768009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a806-6d3d-4300-82b1-0438a8211864 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:15.768599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a806-6d3d-4300-82b1-0438a8211864 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:15.776819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 193/401] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:15.779579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa001ff5-e469-4e98-a09b-027d2c5d0f9d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:15.780068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa001ff5-e469-4e98-a09b-027d2c5d0f9d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:15.780623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa001ff5-e469-4e98-a09b-027d2c5d0f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:15.801927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:15.812690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:15.814500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:15.815961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:15.821183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 209/402] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:00:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 620 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:15.822903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:15.825822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-fa001ff5-e469-4e98-a09b-027d2c5d0f9d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:15.828318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fa001ff5-e469-4e98-a09b-027d2c5d0f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:15.885022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:15.981264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 194/403] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:15.983208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa001ff5-e469-4e98-a09b-027d2c5d0f9d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:16.046856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48365bae-d637-4670-b751-5eca5c89b472 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:16.093816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:16.121694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:16.122880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:16.123386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:16.128783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:16.128783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:16.129296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:16.133473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 210/404] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:15 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:16.150011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:16.417364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa001ff5-e469-4e98-a09b-027d2c5d0f9d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:16.507640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4980f7-2847-4a6e-8a16-84030c0488c8 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:16.508666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:16.508864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:16.509330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:16.509583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:16.510576 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:16.511099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:16.513645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:16.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 195/405] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:16.538194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:16.597706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:16.655670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:16.657319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:16.658121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:16.658894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:16.661426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:16.664636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:16.669551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 211/406] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:16 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:16.677955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:16.806382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d90545-7c0b-43f0-89a5-35de3cb822ba None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:16.813653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:16.886975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:16.888237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:16.888765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:16.889275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:16.891510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:16.894489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:16.904771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 196/407] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:16 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:16.904771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:16.921224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950354a2-a169-4093-ae30-ff5548e2e641 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:16.996881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:16.998472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:16.999173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:16.999952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:17.004225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1956032a34d4caa2f7a4aaea0bafe, group_id=b7dad8aaff2d43aea7cf9a36ddca40b9, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:17.007522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:17.105063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:17.125705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 212/408] 10.222.0.71 () {58 vars in 1442 bytes} [Fri Sep 2 21:00:16 2022] PUT /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:00:17.129006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:17.130502 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a88a67-8936-4c0e-b71b-6fbab380228e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:17.236239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e94259-c247-4fde-8a44-62ccda1bdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:17.237413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94259-c247-4fde-8a44-62ccda1bdf77 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:17.237916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94259-c247-4fde-8a44-62ccda1bdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:17.238412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94259-c247-4fde-8a44-62ccda1bdf77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:17.265721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e94259-c247-4fde-8a44-62ccda1bdf77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-a2e94259-c247-4fde-8a44-62ccda1bdf77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:17.276989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:17.278690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:17.280961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 197/409] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:17.282922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3db4-ad0c-41f6-8a7a-bb04f74e7beb None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:17.282922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3db4-ad0c-41f6-8a7a-bb04f74e7beb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:17.282922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3db4-ad0c-41f6-8a7a-bb04f74e7beb None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:17.284955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 198/410] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:17.292099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3db4-ad0c-41f6-8a7a-bb04f74e7beb None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:17.413420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba4c3a-1031-4b4f-b7b9-09c82c634463 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:17.445643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:17.513913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8ef90-b07a-4406-9ec9-8cb3f961a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:17.517715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ef90-b07a-4406-9ec9-8cb3f961a434 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:17.519284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ef90-b07a-4406-9ec9-8cb3f961a434 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:17.521052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ef90-b07a-4406-9ec9-8cb3f961a434 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:17.524636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8ef90-b07a-4406-9ec9-8cb3f961a434 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:17.527897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8ef90-b07a-4406-9ec9-8cb3f961a434 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:17.532011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 213/411] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:17 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:17.534788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20cdd-c712-4670-a1cc-e38fb45dfa64 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:17.535658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20cdd-c712-4670-a1cc-e38fb45dfa64 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:17.536548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20cdd-c712-4670-a1cc-e38fb45dfa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:17.565088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3db4-ad0c-41f6-8a7a-bb04f74e7beb None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:17.583635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-edf20cdd-c712-4670-a1cc-e38fb45dfa64 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:17.587263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-edf20cdd-c712-4670-a1cc-e38fb45dfa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:17.643976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:17.643976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:17.643976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:17.643976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:17.644979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:17.645497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:17.649984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:17.672884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 199/412] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:17.672884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:17.706190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:17.773752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 214/413] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:17.774731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf20cdd-c712-4670-a1cc-e38fb45dfa64 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:17.865574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729f030-9950-40c4-9d8d-04bb9066e56f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:17.998030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:17.999171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:17.999661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:18.000136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:18.006177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1956032a34d4caa2f7a4aaea0bafe, group_id=b7dad8aaff2d43aea7cf9a36ddca40b9, role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:18.009564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:18.013250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf20cdd-c712-4670-a1cc-e38fb45dfa64 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:18.037108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:18.082646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:18.083718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:18.084322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:18.084869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] PATH_INFO: `/v3/groups/1c7e4109c3454898b8ff774965689b5c` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:18.087643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] RBAC: Authorizing `identity:get_group(group_id=1c7e4109c3454898b8ff774965689b5c)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:18.090447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:18.094307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 215/414] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:17 2022] GET /identity/v3/groups/1c7e4109c3454898b8ff774965689b5c => generated 229 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:18.105747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:18.231800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 200/415] 10.222.0.71 () {58 vars in 1442 bytes} [Fri Sep 2 21:00:17 2022] PUT /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe/groups/b7dad8aaff2d43aea7cf9a36ddca40b9/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:00:18.312513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be344c11-35ac-4f46-98ed-2542920422c5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:18.428444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:18.429711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:18.430224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:18.431717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] PATH_INFO: `/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:18.434363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] RBAC: Authorizing `identity:get_project(project_id=ed07aa8a11c5411cab1c62d6e9841ea5)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:18.437183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:18.441028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 216/416] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:18 2022] GET /identity/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5 => generated 344 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:18.453293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:18.471980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:18.622346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:18.655282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:18.711750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398d8f1-af96-4c33-ae9b-f5aadb27b95c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:18.764076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef213a-6717-48be-8fdb-fda5961fcdce None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:18.799172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ae4ed-9e60-4b90-91c8-757d4b5cf2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:18.800455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae4ed-9e60-4b90-91c8-757d4b5cf2f0 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:18.800986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae4ed-9e60-4b90-91c8-757d4b5cf2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:18.801476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae4ed-9e60-4b90-91c8-757d4b5cf2f0 None admin] PATH_INFO: `/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5/groups/1c7e4109c3454898b8ff774965689b5c/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:18.805346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ae4ed-9e60-4b90-91c8-757d4b5cf2f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed07aa8a11c5411cab1c62d6e9841ea5, group_id=1c7e4109c3454898b8ff774965689b5c, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:18.808603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ae4ed-9e60-4b90-91c8-757d4b5cf2f0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:18.859524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3144d-5553-47e8-a729-b78fbe6cee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:18.863868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3144d-5553-47e8-a729-b78fbe6cee79 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:18.865539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3144d-5553-47e8-a729-b78fbe6cee79 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:18.866363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3144d-5553-47e8-a729-b78fbe6cee79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:18.900108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3144d-5553-47e8-a729-b78fbe6cee79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-66e3144d-5553-47e8-a729-b78fbe6cee79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:18.912422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:18.913886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:18.923296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:18.924396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 201/417] 10.222.0.71 () {58 vars in 1442 bytes} [Fri Sep 2 21:00:18 2022] PUT /identity/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5/groups/1c7e4109c3454898b8ff774965689b5c/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:00:18.924396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea92399-2098-4185-a5cc-2df8a8f5d0cc None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:18.924396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea92399-2098-4185-a5cc-2df8a8f5d0cc None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:18.924396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea92399-2098-4185-a5cc-2df8a8f5d0cc None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:18.924396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 202/418] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:18.929197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 217/419] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:18.938737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea92399-2098-4185-a5cc-2df8a8f5d0cc None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:18.943685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c751d71-dee7-4da3-bd18-70316cc08173 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:18.945140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c751d71-dee7-4da3-bd18-70316cc08173 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:18.945986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c751d71-dee7-4da3-bd18-70316cc08173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:18.986926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2c751d71-dee7-4da3-bd18-70316cc08173 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:18.989652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2c751d71-dee7-4da3-bd18-70316cc08173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:19.210247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea92399-2098-4185-a5cc-2df8a8f5d0cc None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:19.264879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 218/420] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:19.288995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:19.290595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:19.291481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:19.292352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:19.294091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:19.294937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:19.298105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:19.301562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:19.317151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 203/421] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:19.329596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c751d71-dee7-4da3-bd18-70316cc08173 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:19.424866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:19.628823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c751d71-dee7-4da3-bd18-70316cc08173 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:19.720781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:19.721078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:19.721551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:19.722014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:19.948472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:19.951163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:19.967976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:20.053338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:20.290223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 219/422] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 961 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:20.300607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:20.308042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4af259-047f-448a-b692-488add21a6ef None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:20.391520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:20.392621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:20.393039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:20.393577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:20.416205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:20.434492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:20.435718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:20.437373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 204/423] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:00:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:20.449739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:20.710980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:20.760880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c3d2-4df2-4e5b-b70e-05f24f3ca7e3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:20.766506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe385dc-7d11-4d7d-9151-fd84e9142edc None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:20.839454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:20.840932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:20.841682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:20.842275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:20.843964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:20.844493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:20.847474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:20.864659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 205/424] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:20.878801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:20.906474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:20.907652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:20.908116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:20.908543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:20.913176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:20.916448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:20.924612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 220/425] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:20 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 625 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:20.934525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:20.941181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:21.233432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03665577-cb02-4fa2-afb3-0498fc2d7c34 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:21.317329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:21.343660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78068a-e5bb-4882-bb21-8dfd140515f3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:21.345467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6c270-7ddd-4f66-af30-201b598b0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:21.346488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6c270-7ddd-4f66-af30-201b598b0e1b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:21.346952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6c270-7ddd-4f66-af30-201b598b0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:21.347595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6c270-7ddd-4f66-af30-201b598b0e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:21.448547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd3903-320b-4425-8b97-cc3c7329d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:21.450542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3903-320b-4425-8b97-cc3c7329d675 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:21.451437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3903-320b-4425-8b97-cc3c7329d675 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:21.452213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3903-320b-4425-8b97-cc3c7329d675 None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:21.454883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd3903-320b-4425-8b97-cc3c7329d675 None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:21.458361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd3903-320b-4425-8b97-cc3c7329d675 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:21.462647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 221/426] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:20 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:21.465602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8e59-2e64-4993-a953-c3bc5f3c3542 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:21.466507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8e59-2e64-4993-a953-c3bc5f3c3542 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:21.467294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8e59-2e64-4993-a953-c3bc5f3c3542 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:21.471003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 222/427] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:21.473332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8e59-2e64-4993-a953-c3bc5f3c3542 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:21.491683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6c270-7ddd-4f66-af30-201b598b0e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:21.494751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6c270-7ddd-4f66-af30-201b598b0e1b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:21.655955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:21.683411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 206/428] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 806 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:21.686055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fee69-2cf4-4d36-8e7c-ae27e662a579 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:21.686879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fee69-2cf4-4d36-8e7c-ae27e662a579 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:21.687534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fee69-2cf4-4d36-8e7c-ae27e662a579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:21.720781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-557fee69-2cf4-4d36-8e7c-ae27e662a579 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:21.722850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-557fee69-2cf4-4d36-8e7c-ae27e662a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:21.745443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8e59-2e64-4993-a953-c3bc5f3c3542 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:21.749980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:21.831642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:21.834020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:21.834831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:21.835635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:21.838162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=7b439539190246dab7b521b2ea009f17) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:21.839272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:21.842272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:21.856008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 223/429] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:21 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=2e8ee3364fce49668856661174d3b27d => generated 611 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:21.858470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:21.880362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 207/430] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:22.078699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e940b1-f520-40b2-8f4b-1989661694dd None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:22.148166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33ea06-0057-4426-957b-8baa8de950ab None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:22.148660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33ea06-0057-4426-957b-8baa8de950ab None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:22.149219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33ea06-0057-4426-957b-8baa8de950ab None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:22.157325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 208/431] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:22.160969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:22.161267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e868d-ef48-434d-82bd-ef08bc3eaf54 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:22.161711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e868d-ef48-434d-82bd-ef08bc3eaf54 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:22.162190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e868d-ef48-434d-82bd-ef08bc3eaf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:22.163404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:22.164182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:22.165083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] PATH_INFO: `/v3/projects/7b439539190246dab7b521b2ea009f17` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:22.167696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] RBAC: Authorizing `identity:get_project(project_id=7b439539190246dab7b521b2ea009f17)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:22.170908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:22.175155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 224/432] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:21 2022] GET /identity/v3/projects/7b439539190246dab7b521b2ea009f17 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:22.186424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:22.194524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:22.214882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9c7e868d-ef48-434d-82bd-ef08bc3eaf54 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:22.220180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9c7e868d-ef48-434d-82bd-ef08bc3eaf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:22.381400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 209/433] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:22.519805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a74e-24c1-422a-b1e6-0c222dad6a20 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:22.579229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e868d-ef48-434d-82bd-ef08bc3eaf54 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:22.640609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:22.641665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:22.642147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:22.642601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:22.645051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:22.647947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:22.655814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 225/434] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:22 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:22.676327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:22.833414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:22.846411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:22.861784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e868d-ef48-434d-82bd-ef08bc3eaf54 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:22.914224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98c65a-6d4a-43b0-9677-6d837498e379 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:22.951493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:22.955380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:22.956364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:22.957175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:22.980646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:22.989184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7da5c0-c249-4b83-ac34-e121c876b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:22.990217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7da5c0-c249-4b83-ac34-e121c876b170 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:22.990681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7da5c0-c249-4b83-ac34-e121c876b170 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:22.991130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7da5c0-c249-4b83-ac34-e121c876b170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:22.992304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:22.994437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:00:22.996290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:22.998501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7da5c0-c249-4b83-ac34-e121c876b170 None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=7b439539190246dab7b521b2ea009f17) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:22.999053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 210/435] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:22.999708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7da5c0-c249-4b83-ac34-e121c876b170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:23.002936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7da5c0-c249-4b83-ac34-e121c876b170 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:23.014200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:23.017442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 226/436] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:22 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=7b439539190246dab7b521b2ea009f17&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 611 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:23.020121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3cc9-b3b5-4a85-81cd-805c649dd442 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:23.021081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3cc9-b3b5-4a85-81cd-805c649dd442 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:23.021907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3cc9-b3b5-4a85-81cd-805c649dd442 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:23.025551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 227/437] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:23.037105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6ac9-7d16-495b-9783-1a3c26c9b864 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:23.038005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6ac9-7d16-495b-9783-1a3c26c9b864 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:23.038853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6ac9-7d16-495b-9783-1a3c26c9b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:23.079924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-64ef6ac9-7d16-495b-9783-1a3c26c9b864 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:23.082195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-64ef6ac9-7d16-495b-9783-1a3c26c9b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:23.280326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 228/438] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:23.281900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef6ac9-7d16-495b-9783-1a3c26c9b864 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:23.315410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b820-c420-462a-8bbb-2084e61d8678 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:23.446754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:23.449251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:23.450100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:23.450837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:23.452453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] RBAC: Adding query filter params (name=member) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:23.453581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:23.456691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:23.457437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:23.476355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:23.486807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 211/439] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:00:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:23.497620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:23.543641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef6ac9-7d16-495b-9783-1a3c26c9b864 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:23.616175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:23.617713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:23.618462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:23.619167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:23.641965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:23.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:23.653946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:23.655287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:23.659079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 229/440] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:00:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:23.670222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:23.723020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b229a0-d988-4f61-95ed-5d5e36757791 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:23.818407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:23.819236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:23.819644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:23.820026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:23.892359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b10b3-6283-4070-9abb-59e9306c68c7 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:23.946428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:23.949823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:23.951515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:23.955339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:23.972428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:23.973508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:23.973991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:23.974465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:23.975701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:23.976235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:23.979542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:23.996029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 230/441] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:23.997563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:24.168171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 212/442] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:24.171685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:24.216333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb73e4-599b-48a9-89a7-ed890a0d94f2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:24.294764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:24.295859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:24.296369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:24.296914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:24.315161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:24.323258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:24.325163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 231/443] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:00:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:24.326831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:24.366270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:24.373178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bcc13-0f75-4a1b-9285-7a03cf41171e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:24.426329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:24.450655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:24.451674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:24.451829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:24.452361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:24.531659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3638b92-2d4c-401b-bd27-930212657a1e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:24.589815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:24.590890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:24.591380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:24.591833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:24.593740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:24.594154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:24.595640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:24.596289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:24.599628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 232/444] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:24 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:24.600266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:24.800508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:24.802106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed433927-a6a4-4151-a45f-7d2040292351 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:24.808788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 213/445] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:24.810464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:24.839433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:24.893407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:24.894449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:24.901643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:24.902206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:24.903484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:24.904115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:24.906745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:24.933664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 233/446] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:24.935281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:25.037206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11548a37-e467-4cf6-9ca0-f9165af4962c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:25.113995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:25.114957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:25.115427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:25.115897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:25.118926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:25.121835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:25.125085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 214/447] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:24 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:25.126666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:25.145452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01f5c-c605-4cbd-bbbf-2a7d4691f91c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:25.212758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:25.213714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:25.214140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:25.214541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] PATH_INFO: `/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:25.216567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d1956032a34d4caa2f7a4aaea0bafe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:25.219232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:25.222411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 234/448] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:24 2022] GET /identity/v3/projects/d5d1956032a34d4caa2f7a4aaea0bafe => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:25.223846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:25.298650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:25.341483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:25.424900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d9ea-c309-4b73-b601-78f11b43edbb None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:25.487353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b7c3-03e2-4397-8841-6ae2dbd9e6c9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:25.517919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:25.518893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:25.519382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:25.519670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:25.580365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:25.580997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:25.581394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:25.582147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:25.583119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=2e8ee3364fce49668856661174d3b27d, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:25.583119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:25.585460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:25.600550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 235/449] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:25 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=2e8ee3364fce49668856661174d3b27d => generated 611 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:25.601696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:25.693277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:25.700582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:25.904777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc518c-609d-4e1b-a114-a0cf864154f6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:25.915311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:25.932613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:25.993677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:25.994898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:25.995481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:25.995819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] PATH_INFO: `/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:25.997825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] RBAC: Authorizing `identity:get_group(group_id=b7dad8aaff2d43aea7cf9a36ddca40b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:25.999745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:26.002465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 236/450] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:25 2022] GET /identity/v3/groups/b7dad8aaff2d43aea7cf9a36ddca40b9 => generated 226 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:26.006858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 215/451] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:26.013977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:26.017127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:26.280269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0697f8-131a-4474-b6ca-07a4d538128b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:26.288830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20336b-1605-4209-9ebf-8b537ffc4f7b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:26.357163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:26.358167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:26.358657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:26.359147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:26.360578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] RBAC: Adding query filter params (group.id=b7dad8aaff2d43aea7cf9a36ddca40b9, role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:26.361167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:26.363639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:26.374605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 237/452] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:26 2022] GET /identity/v3/role_assignments?group.id=b7dad8aaff2d43aea7cf9a36ddca40b9&scope.project.id=d5d1956032a34d4caa2f7a4aaea0bafe&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 611 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:26.374941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:26.375691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:26.376156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:26.376712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] PATH_INFO: `/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:26.379223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] RBAC: Authorizing `identity:get_project(project_id=ed07aa8a11c5411cab1c62d6e9841ea5)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:26.382141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:26.385091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 216/453] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:00:26 2022] GET /identity/v3/projects/ed07aa8a11c5411cab1c62d6e9841ea5 => generated 344 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:26.392881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:26.487748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:26.622080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de4af-e67a-47e2-958e-381460cc674c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:26.684393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bdd4e-620c-4e6d-917f-84d4e0b96594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:26.685234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bdd4e-620c-4e6d-917f-84d4e0b96594 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:26.685605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bdd4e-620c-4e6d-917f-84d4e0b96594 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:26.686073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bdd4e-620c-4e6d-917f-84d4e0b96594 None admin] PATH_INFO: `/v3/groups/1c7e4109c3454898b8ff774965689b5c` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:26.687786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bdd4e-620c-4e6d-917f-84d4e0b96594 None admin] RBAC: Authorizing `identity:get_group(group_id=1c7e4109c3454898b8ff774965689b5c)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:26.689483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bdd4e-620c-4e6d-917f-84d4e0b96594 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:26.691934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 238/454] 10.222.0.71 () {56 vars in 1180 bytes} [Fri Sep 2 21:00:26 2022] GET /identity/v3/groups/1c7e4109c3454898b8ff774965689b5c => generated 229 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:26.701005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:26.786434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:26.935795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a27d-ad66-4acc-8f82-3e70f612f586 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:26.998241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372f6f3-29a7-45e3-bdd2-008973dccba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:26.999010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372f6f3-29a7-45e3-bdd2-008973dccba5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:26.999384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372f6f3-29a7-45e3-bdd2-008973dccba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:26.999746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372f6f3-29a7-45e3-bdd2-008973dccba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:27.000644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372f6f3-29a7-45e3-bdd2-008973dccba5 None admin] RBAC: Adding query filter params (group.id=1c7e4109c3454898b8ff774965689b5c, role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=ed07aa8a11c5411cab1c62d6e9841ea5) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:27.001082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372f6f3-29a7-45e3-bdd2-008973dccba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:27.002805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372f6f3-29a7-45e3-bdd2-008973dccba5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:27.011603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 217/455] 10.222.0.71 () {56 vars in 1376 bytes} [Fri Sep 2 21:00:26 2022] GET /identity/v3/role_assignments?group.id=1c7e4109c3454898b8ff774965689b5c&scope.project.id=ed07aa8a11c5411cab1c62d6e9841ea5&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 611 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:31.101063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb205-8fa3-458b-857d-5f076585507f None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:31.103270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb205-8fa3-458b-857d-5f076585507f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:31.104047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bb205-8fa3-458b-857d-5f076585507f None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:31.107493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 239/456] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:31.116511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ac559-28c2-447b-a06d-539e7b1e367f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:31.118144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ac559-28c2-447b-a06d-539e7b1e367f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:31.118949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ac559-28c2-447b-a06d-539e7b1e367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:31.160957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-519ac559-28c2-447b-a06d-539e7b1e367f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:31.165802 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-519ac559-28c2-447b-a06d-539e7b1e367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:31.353547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 218/457] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:31.523234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476596d-372b-47a7-bafe-02209565e106 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:31.525446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476596d-372b-47a7-bafe-02209565e106 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:31.526352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476596d-372b-47a7-bafe-02209565e106 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:31.529746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 240/458] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:31.538705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95561bf2-a093-4d06-8d93-22082b72414a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:31.540181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95561bf2-a093-4d06-8d93-22082b72414a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:31.540953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95561bf2-a093-4d06-8d93-22082b72414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:31.587421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-95561bf2-a093-4d06-8d93-22082b72414a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:31.589900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-95561bf2-a093-4d06-8d93-22082b72414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:31.644214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:31.749617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 219/459] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:32.004817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a95b7f-b04e-4475-8921-613621585d84 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:32.005341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a95b7f-b04e-4475-8921-613621585d84 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:32.005855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a95b7f-b04e-4475-8921-613621585d84 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:32.009004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 241/460] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:32.017979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53173e-2a52-47dd-8603-8d4e690e9c6f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:32.018493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53173e-2a52-47dd-8603-8d4e690e9c6f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:32.018989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53173e-2a52-47dd-8603-8d4e690e9c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:32.064757 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0e53173e-2a52-47dd-8603-8d4e690e9c6f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:32.066954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0e53173e-2a52-47dd-8603-8d4e690e9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:32.257479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 220/461] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:32.279128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a95b7f-b04e-4475-8921-613621585d84 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:32.411706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53173e-2a52-47dd-8603-8d4e690e9c6f None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:32.551802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a95b7f-b04e-4475-8921-613621585d84 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:32.589347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:32.615614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:32.645722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53173e-2a52-47dd-8603-8d4e690e9c6f None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:32.659436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:32.660500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:32.661223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:32.661872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:32.697308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:32.707692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:32.714076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:32.715134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:32.715738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:32.716337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:32.740915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:32.744123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:32.760310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:32.762099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:32.763777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:32.763777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:32.763777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:32.776257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 242/462] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:32.784763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:32.786482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:32.788121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:32.788121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:32.788121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:32.788121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 221/463] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:32.788541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:32.795850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:33.017987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8944-dce4-49a2-9402-64a0011e64bc None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:33.065722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e731349-7b08-48bd-b247-72fafd3d1f64 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:33.109987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:33.111700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:33.112300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:33.112849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:33.113824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:33.114400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:33.116801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:33.153579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 243/464] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:33.154823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:33.182624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b973080-63c7-46c5-901c-747e8d42fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:33.183527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973080-63c7-46c5-901c-747e8d42fd01 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:33.183952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973080-63c7-46c5-901c-747e8d42fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:33.184368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973080-63c7-46c5-901c-747e8d42fd01 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:33.185251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b973080-63c7-46c5-901c-747e8d42fd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:33.185771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b973080-63c7-46c5-901c-747e8d42fd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:33.187542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b973080-63c7-46c5-901c-747e8d42fd01 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:33.210389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 222/465] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:33.213431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6e578-b528-4733-b324-99333c27af11 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:33.213919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6e578-b528-4733-b324-99333c27af11 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:33.214368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6e578-b528-4733-b324-99333c27af11 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:33.221452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 223/466] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:33.223224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6e578-b528-4733-b324-99333c27af11 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:33.228450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:33.229117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:33.412534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98c33a-dba1-4bc3-8ce7-89547af550b8 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:33.497129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6e578-b528-4733-b324-99333c27af11 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:33.512129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:33.513274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:33.513809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:33.514259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:33.536485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:33.538956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:33.569212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:33.571505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:33.573050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:33.573050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:33.573050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:33.573050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 244/467] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:33.573050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:33.583836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475657d-1f97-4b67-9552-0a5402975455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:33.585001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475657d-1f97-4b67-9552-0a5402975455 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:33.585571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475657d-1f97-4b67-9552-0a5402975455 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:33.586099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475657d-1f97-4b67-9552-0a5402975455 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:33.587920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475657d-1f97-4b67-9552-0a5402975455 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:33.590930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475657d-1f97-4b67-9552-0a5402975455 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:33.751544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 224/468] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:00:33 2022] POST /identity/v3/users => generated 246 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:00:33.754039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b86e-4c34-4ac9-b86b-75cfbc209118 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:33.754534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b86e-4c34-4ac9-b86b-75cfbc209118 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:33.755082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b86e-4c34-4ac9-b86b-75cfbc209118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:33.759297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:33.803585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-cbf4b86e-4c34-4ac9-b86b-75cfbc209118 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:33.804293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-cbf4b86e-4c34-4ac9-b86b-75cfbc209118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:33.852647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b07bd-6f1a-49c7-b601-f78a92cf3bfa None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:33.946092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:33.954811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca0bd-561e-4ea1-a7fe-3bcda61d6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:33.961178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca0bd-561e-4ea1-a7fe-3bcda61d6512 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:33.961178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca0bd-561e-4ea1-a7fe-3bcda61d6512 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:33.961178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca0bd-561e-4ea1-a7fe-3bcda61d6512 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:33.961178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca0bd-561e-4ea1-a7fe-3bcda61d6512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:33.961178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca0bd-561e-4ea1-a7fe-3bcda61d6512 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:33.997807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 225/469] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:34.000479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b86e-4c34-4ac9-b86b-75cfbc209118 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:34.074299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 245/470] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:00:33 2022] POST /identity/v3/users => generated 248 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:00:34.078079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8fe58-fe0e-41f0-a5df-010a514a0205 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:34.081116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8fe58-fe0e-41f0-a5df-010a514a0205 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:34.081833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8fe58-fe0e-41f0-a5df-010a514a0205 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:34.083677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 246/471] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:34.115320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f844b6b-9452-48af-9e37-3a56d3b437b7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:34.115934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f844b6b-9452-48af-9e37-3a56d3b437b7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:34.116392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f844b6b-9452-48af-9e37-3a56d3b437b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:34.181242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2f844b6b-9452-48af-9e37-3a56d3b437b7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:34.183585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2f844b6b-9452-48af-9e37-3a56d3b437b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:34.297795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b86e-4c34-4ac9-b86b-75cfbc209118 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:34.415173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:34.416247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:34.416817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:34.417342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:34.418534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:34.419902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:34.421803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:34.457438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 247/472] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:34.469035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 226/473] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:34.478082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f844b6b-9452-48af-9e37-3a56d3b437b7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:34.531612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:34.645388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:34.675459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:34.736220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f844b6b-9452-48af-9e37-3a56d3b437b7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:34.813081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505fbc5-140d-4798-94a5-9233460a5d2f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:34.813910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:34.814931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:34.815588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:34.815869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:34.817503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:34.822544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:34.901485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:34.902587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:34.903071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:34.903522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:34.925334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:34.928384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:34.959396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:34.962173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:34.965048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:34.965048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:34.965048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:34.965048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 227/474] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:34.975612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:34.994000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 248/475] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:00:34 2022] POST /identity/v3/users => generated 248 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:00:35.000641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:35.194997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:35.201311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfef403-4184-4585-9953-51f9cd8777b5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:35.268192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:35.269252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:35.269686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:35.270116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:35.271308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:35.271810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:35.274274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:35.284355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef7a6f-5543-4e5b-bccb-1ac403ba2607 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:35.297184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 228/476] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:35.309658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:35.349244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:35.429249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:35.430822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:35.431277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:35.431718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:35.433066 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:35.437194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:35.500017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.sql.core [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 21:00:35.500017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 21:00:35.500017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [parameters: {'id': '1b36bde55dbf4f60afb71dd0d266daaf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 21:00:35.500017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82093) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result.read() Sep 02 21:00:35.538008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return ref.to_dict() Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:00:35.539452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application yield resource Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise self.value Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application session.commit() Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 21:00:35.541674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.session.flush() Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application compat.raise_( Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 21:00:35.543906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:00:35.548548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result.read() Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:00:35.550778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [parameters: {'id': '1b36bde55dbf4f60afb71dd0d266daaf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:35.552498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 21:00:35.554543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:35.558885 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 249/477] 10.222.0.71 () {60 vars in 1131 bytes} [Fri Sep 2 21:00:34 2022] POST /identity/v3/roles => generated 144 bytes in 548 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:35.567138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:35.753036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388434-856a-4892-8396-905cf2fbce1e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:35.844148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0169e4-f2f4-430b-b6ea-84e12271d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:35.845280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0169e4-f2f4-430b-b6ea-84e12271d7a8 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:35.845702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0169e4-f2f4-430b-b6ea-84e12271d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:35.846078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0169e4-f2f4-430b-b6ea-84e12271d7a8 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:35.853153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0169e4-f2f4-430b-b6ea-84e12271d7a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:35.856000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0169e4-f2f4-430b-b6ea-84e12271d7a8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:35.867928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2769e-634c-4797-833e-b2cba71b9308 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:35.947868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:35.949098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:35.949609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:35.950183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:35.975384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:35.987626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:35.994707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:35.996187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 250/478] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:00:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:36.001902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:36.006659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 229/479] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:00:35 2022] POST /identity/v3/users => generated 249 bytes in 698 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:00:36.099050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:36.251942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eeb72-db25-424d-8f8a-0b918da52799 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:36.324393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa6ec3-94db-4385-a1d6-56fd91f63117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:36.325405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa6ec3-94db-4385-a1d6-56fd91f63117 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:36.326078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa6ec3-94db-4385-a1d6-56fd91f63117 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:36.326567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa6ec3-94db-4385-a1d6-56fd91f63117 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:36.327796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa6ec3-94db-4385-a1d6-56fd91f63117 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:36.328342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa6ec3-94db-4385-a1d6-56fd91f63117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:36.331014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa6ec3-94db-4385-a1d6-56fd91f63117 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:36.350061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 251/480] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:37.751333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e536-2269-41b5-9585-102f4444c9f0 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:37.752054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e536-2269-41b5-9585-102f4444c9f0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:37.752176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e536-2269-41b5-9585-102f4444c9f0 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:37.755289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 230/481] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:37.764493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f2e70-8caa-47f9-b188-43a17a2f7416 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:37.765261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f2e70-8caa-47f9-b188-43a17a2f7416 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:37.765574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f2e70-8caa-47f9-b188-43a17a2f7416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:37.810732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4a6f2e70-8caa-47f9-b188-43a17a2f7416 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:37.812910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4a6f2e70-8caa-47f9-b188-43a17a2f7416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:37.977610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 252/482] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:38.337828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68428786-f64e-4529-a9e1-27f65f717a51 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:38.338713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68428786-f64e-4529-a9e1-27f65f717a51 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:38.339366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68428786-f64e-4529-a9e1-27f65f717a51 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:38.342755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 231/483] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:38.353290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74b2bb-535e-4594-987e-bda8a451499b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:38.353799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74b2bb-535e-4594-987e-bda8a451499b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:38.354239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74b2bb-535e-4594-987e-bda8a451499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:38.395749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-5c74b2bb-535e-4594-987e-bda8a451499b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:38.398039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5c74b2bb-535e-4594-987e-bda8a451499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:38.479327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:38.597527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 253/484] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:38.683636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68428786-f64e-4529-a9e1-27f65f717a51 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:38.738232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:39.007430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68428786-f64e-4529-a9e1-27f65f717a51 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:39.107045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:39.108162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:39.108657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:39.109196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:39.140653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:39.154894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:39.156657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:39.160568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 232/485] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:39.167414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74b2bb-535e-4594-987e-bda8a451499b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:39.224630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:39.447311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:39.532777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74b2bb-535e-4594-987e-bda8a451499b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:39.544789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49474a-c88f-449d-a86e-fc252f6555e8 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:39.596205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7ae7-fc36-4537-b48d-9d0d3942e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:39.597095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7ae7-fc36-4537-b48d-9d0d3942e6dd None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:39.600785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7ae7-fc36-4537-b48d-9d0d3942e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:39.600785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7ae7-fc36-4537-b48d-9d0d3942e6dd None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:39.600785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7ae7-fc36-4537-b48d-9d0d3942e6dd None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:39.600785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7ae7-fc36-4537-b48d-9d0d3942e6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:39.602709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7ae7-fc36-4537-b48d-9d0d3942e6dd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:39.619646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7f399-25f1-4983-a849-f1dff28698f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:39.620785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7f399-25f1-4983-a849-f1dff28698f4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:39.621381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7f399-25f1-4983-a849-f1dff28698f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:39.621884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7f399-25f1-4983-a849-f1dff28698f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:39.627288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 254/486] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:39.630033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d18d-ae6e-4f07-a551-fb5a6753a42c None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:39.630502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d18d-ae6e-4f07-a551-fb5a6753a42c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:39.630928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d18d-ae6e-4f07-a551-fb5a6753a42c None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:39.633791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 255/487] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:39.635234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d18d-ae6e-4f07-a551-fb5a6753a42c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:39.643484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7f399-25f1-4983-a849-f1dff28698f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e3a7f399-25f1-4983-a849-f1dff28698f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:39.653666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:39.655817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:39.657437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 233/488] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:39.658711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00fb3-c9cf-4b5a-bee4-a16b315ff947 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:39.658711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00fb3-c9cf-4b5a-bee4-a16b315ff947 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:39.658711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00fb3-c9cf-4b5a-bee4-a16b315ff947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:39.689639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:39.691945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-44c00fb3-c9cf-4b5a-bee4-a16b315ff947 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:39.694313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-44c00fb3-c9cf-4b5a-bee4-a16b315ff947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:39.846384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 234/489] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:39.848270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c00fb3-c9cf-4b5a-bee4-a16b315ff947 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:39.863758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d18d-ae6e-4f07-a551-fb5a6753a42c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:39.932209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:39.933485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:39.933991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:39.934340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:39.957044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:39.959622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:40.010747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:40.014401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:40.017672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:40.017672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:40.017672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:40.017672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 256/490] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:40.024767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:40.065521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:40.185332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:40.232891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c00fb3-c9cf-4b5a-bee4-a16b315ff947 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:40.234957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f645a-c2f2-4a26-b430-e7095c215fb1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:40.301054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:40.301984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:40.302468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:40.302940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:40.304070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:40.304959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:40.308443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:40.337013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 257/491] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:40.341871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:40.406036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:40.407092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:40.407588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:40.408092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:40.409392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:40.409955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:40.412657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:40.450927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 235/492] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:40.458867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:40.548845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1cb6a-eaf5-45bd-89f6-b313cf7cbab5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:40.642446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:40.643456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:40.643918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:40.644430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] PATH_INFO: `/v3/users/nova` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:40.653909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:40.664331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:40.667413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:40.693720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:40.704933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 258/493] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:00:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:40.706597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:40.745863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a601d-7d51-4830-8163-493be856d37d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:40.799724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:40.813631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03b2a8-9fdc-4f0d-8ab2-2323bf1b6ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:40.814748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03b2a8-9fdc-4f0d-8ab2-2323bf1b6ec8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:40.815240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03b2a8-9fdc-4f0d-8ab2-2323bf1b6ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:40.815712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03b2a8-9fdc-4f0d-8ab2-2323bf1b6ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:40.836470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03b2a8-9fdc-4f0d-8ab2-2323bf1b6ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:40.838765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03b2a8-9fdc-4f0d-8ab2-2323bf1b6ec8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-cf03b2a8-9fdc-4f0d-8ab2-2323bf1b6ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:40.859763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:40.861663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:40.863334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:40.863334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:40.863334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:40.863334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 236/494] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:40.865189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34257a-16c1-4199-93a6-e8e327f296bd None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:40.865405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34257a-16c1-4199-93a6-e8e327f296bd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:40.865843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34257a-16c1-4199-93a6-e8e327f296bd None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:40.875410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 237/495] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:40.877868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861756ea-dd68-4447-8acd-4a56a34e00ed None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:40.878285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861756ea-dd68-4447-8acd-4a56a34e00ed None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:40.879037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861756ea-dd68-4447-8acd-4a56a34e00ed None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:40.880626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 238/496] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:40.881604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861756ea-dd68-4447-8acd-4a56a34e00ed None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:40.926021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751965f3-50c3-4268-8a1d-c23e854f107f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:40.996440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:40.997571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:40.998080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:40.998575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:41.032430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:41.041481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:41.043354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 259/497] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:41.045854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:41.125717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861756ea-dd68-4447-8acd-4a56a34e00ed None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:41.172287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:41.189620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b561cc-66b9-4559-9329-ec564c075add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:41.189620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b561cc-66b9-4559-9329-ec564c075add None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:41.189620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b561cc-66b9-4559-9329-ec564c075add None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:41.189620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b561cc-66b9-4559-9329-ec564c075add None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:41.190605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b561cc-66b9-4559-9329-ec564c075add None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:41.191002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b561cc-66b9-4559-9329-ec564c075add None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:41.193016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b561cc-66b9-4559-9329-ec564c075add None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:41.262299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a000-792d-4120-8261-6f4633e4e156 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:41.263158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 239/498] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:00:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:41.264987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4fe40-0c33-4f42-a797-5f28c246e2ac None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:41.265469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4fe40-0c33-4f42-a797-5f28c246e2ac None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:41.266012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4fe40-0c33-4f42-a797-5f28c246e2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:41.296303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-efe4fe40-0c33-4f42-a797-5f28c246e2ac None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:41.298417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-efe4fe40-0c33-4f42-a797-5f28c246e2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:41.342618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ef2e-aacf-4eda-bb4f-ec25d59e776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:41.343842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ef2e-aacf-4eda-bb4f-ec25d59e776b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:41.344340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ef2e-aacf-4eda-bb4f-ec25d59e776b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:41.344851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ef2e-aacf-4eda-bb4f-ec25d59e776b None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:41.346079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ef2e-aacf-4eda-bb4f-ec25d59e776b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:41.346679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ef2e-aacf-4eda-bb4f-ec25d59e776b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:41.349387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ef2e-aacf-4eda-bb4f-ec25d59e776b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:41.362952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:41.370294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 260/499] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:41.372400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c086-a506-4364-b24d-ae55b74af7f4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:41.372714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c086-a506-4364-b24d-ae55b74af7f4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:41.378972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265c086-a506-4364-b24d-ae55b74af7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:41.400599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-8265c086-a506-4364-b24d-ae55b74af7f4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:41.402733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8265c086-a506-4364-b24d-ae55b74af7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:41.474993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 240/500] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:41.482427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4fe40-0c33-4f42-a797-5f28c246e2ac None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:41.550203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 261/501] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:41.552300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265c086-a506-4364-b24d-ae55b74af7f4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:41.662588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:41.705203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4fe40-0c33-4f42-a797-5f28c246e2ac None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:41.786663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:41.787618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:41.788100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:41.788561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:41.790484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:41.791180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:41.793707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:41.798498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265c086-a506-4364-b24d-ae55b74af7f4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:41.816779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 241/502] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:41.816779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:41.877271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:41.879020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:41.879648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:41.880371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:41.881217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:42.019710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:42.022919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:42.032986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd1b59-2873-4119-a54c-43ef5bfd0aac None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:42.089870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:42.090852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:42.091342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:42.091809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:42.106740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:42.109604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:42.131277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:42.134453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:42.137132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 242/503] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:42.139332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:42.256998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 262/504] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:42.259187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:42.322045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:42.341098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986faa0-bac2-4772-813f-988cfff991ec None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:42.405763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:42.406819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:42.407303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:42.407778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:42.427772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:42.431422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:42.445147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d2cc7-b8e8-4c52-aed4-a78d2cd66001 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:42.463275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:42.465177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:42.466887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:42.466887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:42.466887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:42.466887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 243/505] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:42.466887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:42.531303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:42.532270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:42.532764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:42.533224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:42.550718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:42.552324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:42.565512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:42.578237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:42.588019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:42.589122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:42.589122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:42.589122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:42.589122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 263/506] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:42.589122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:42.678682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36301a1e-2013-4f66-9b55-4b15776d8116 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:42.751033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:42.752059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:42.752514 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:42.753014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:42.775298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:42.786699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:42.787866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:42.788695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:42.791419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 244/507] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:42.794453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:42.798952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:42.812901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb3ea-2696-4a64-8e37-c9f56dc4b72c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:42.892281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:42.893288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:42.893753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:42.894240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:42.895516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:42.896059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:42.899203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:42.971933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 264/508] 10.222.0.71 () {56 vars in 1137 bytes} [Fri Sep 2 21:00:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:42.973627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:43.007834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7f903-b5da-4765-8de2-a9b5ad9ddbe3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:43.077405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:43.078465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:43.079097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:43.079611 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:43.098085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:43.108412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:43.111376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:43.138110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:43.140532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:43.142868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:43.142868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:43.142868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:43.142868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 245/509] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:43.142868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:43.190853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096208b-869c-4c4f-9e3d-058bbb5a58c1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:43.274933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:43.275979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:43.276565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:43.278127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:43.278127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:43.278506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:43.280890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:43.281387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:43.310863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 265/510] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:43.312351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:43.383537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d5b3e-328a-4554-a717-40fded9991a6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:43.454391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:43.455090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:43.455415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:43.455753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:43.456997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:43.457472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:43.459920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:43.478166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863eac4-a284-4f08-a6d7-9b2f2b19468f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:43.488769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 246/511] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:43.488769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:43.527027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:43.557127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:43.557845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:43.558224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:43.558593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:43.559424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:43.559838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:43.561498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:43.574208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 266/512] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:43.575771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:43.676970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4983d-7884-4727-b30e-a5759815487f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:43.703331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:43.738294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:43.739041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:43.739370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:43.739702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:43.740613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5244aa9-9858-4dee-9c73-afd09023bbf0 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:43.814696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:43.815364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:43.815722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:43.816067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:43.816914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:43.817294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:43.819069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:43.839762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 267/513] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:43.841041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:43.876907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:43.879841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:43.933827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:44.070934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5520bc-3cb2-40d5-b0b0-3db2bd567376 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:44.102633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 247/514] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:44.103961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:44.130705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:44.133225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:44.134172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:44.134553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:44.134891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:44.153589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:44.156045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:44.172278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:44.174166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 268/515] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:44.176588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:44.319540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd127b9-7185-4be9-b538-869f59d8c694 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:44.374056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:44.380517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79858079-18be-4d40-a05c-b5bd0026fd15 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:44.388250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:44.389212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:44.392386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:44.392386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:44.392386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:44.392876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:44.451136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:44.452211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:44.452686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:44.453204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:44.474182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:44.477973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:44.503246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 248/516] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:00:44 2022] POST /identity/v3/users => generated 247 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:00:44.504952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:44.508961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:44.512665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:44.515459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:44.515459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:44.515459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:44.515459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 269/517] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:44.515459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:44.671202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:44.747920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0dc9-8b02-477b-96c0-a38921c9e8d7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:44.789805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ebce4-7f90-45aa-b679-6b871c10b7dd None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:44.814264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:44.815249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:44.815706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:44.819536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:44.832492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:44.835257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:00:44.855288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:44.861247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 249/518] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:44.863397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:44.875480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:44.876560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:44.877059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:44.877554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:44.905669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:44.908469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:44.938101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:44.939878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:44.941587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:44.941587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:44.941587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:44.941862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 270/519] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:44.943953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:44.950474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:45.117611 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d4716-978c-4f7b-813c-ed65e4d96646 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:45.188798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1fb8-47e4-43e7-9d3c-d7a5712745fb None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:45.190524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:45.205047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:45.207421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:45.207421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:45.207421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:45.209163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:45.209163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:45.211622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:45.254952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 250/520] 10.222.0.71 () {56 vars in 1137 bytes} [Fri Sep 2 21:00:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:45.254952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:45.277098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:45.278526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:45.279002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:45.279625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:45.280871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:45.281418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:45.284135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:45.316264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 271/521] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:45.316264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:45.454021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:45.507500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47e77-87d6-4dc7-ba56-8b5d1db7ef41 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:45.553714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dafa9-6a17-4d02-b41d-c21572446c40 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:45.580684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:45.581761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:45.582255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:45.582731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:45.584032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:45.584524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:45.589182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:45.633744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:45.634792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:45.635276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:45.635766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:45.637009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:45.637536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:45.646976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 251/522] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:45.646976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:45.647347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:45.682600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 272/523] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:45.682600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:45.788125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:45.901344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e9f1-77cf-431c-8f24-984f3f540033 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:45.936191 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea324-a307-4831-8e11-ba8b881fb3b0 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:45.990024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:45.990886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:45.991077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:45.991299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:45.991776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:46.016896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:46.018763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:46.019628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:46.020460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:46.037880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:46.040553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:46.073215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:46.074304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:00:46.075228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:46.076121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 273/524] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:46.077301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:46.171887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:46.175249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:46.296907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:46.348558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63acd-4eb5-47a4-ae6c-fe5aa94babb3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:46.444408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 252/525] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:46.444408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:46.452083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:46.453153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:46.453652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:46.454147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:46.455581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a55753c439f54804814aca0a3feb96ed) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:46.456131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:46.459214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:46.471348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 274/526] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:00:46 2022] GET /identity/v3/role_assignments?user.id=a55753c439f54804814aca0a3feb96ed&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:46.472258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:46.600674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:46.716255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd96fd4-3f47-42be-8422-14ad4d3d603d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:46.763823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129e911-d827-469b-95a7-069fc04a540b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:46.812442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:46.813671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:46.814200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:46.814782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:46.828285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:46.831027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:46.853541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:46.854450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:46.854918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:46.855372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:46.856668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:46.857198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:00:46.857511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:46.859061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:46.860894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:46.861747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:46.862194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 253/527] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:46.862194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:46.883323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:46.896579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 275/528] 10.222.0.71 () {56 vars in 1139 bytes} [Fri Sep 2 21:00:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:46.902760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:47.072414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d2bc5-5b08-4f02-991a-e4d2cd92a8f6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:47.103088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bfa17-1886-4899-b2d1-52e47f6ce7dc None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:47.108387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:47.144053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:47.145589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.146340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.147041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.170322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:47.172433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:47.186233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:47.187986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.189802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.190587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.192229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:47.193104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:47.196986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:47.222113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:47.223871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:47.225531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:47.225531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:47.225531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:47.225531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 254/529] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:47.225531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:47.237800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 276/530] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:47.252619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:47.372315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:47.455928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be946d3-ed4a-42d4-944f-880b9d8bcd1b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:47.460436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b687d9-b480-4672-b201-a8060a0f057a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:47.529002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:47.530776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.531782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.532550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.534372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=36f0ee202c7946db8c77e1048d092fde) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:47.535166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:47.537108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:47.539841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e077515-a362-4af0-8122-736d8f8876db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:47.540997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e077515-a362-4af0-8122-736d8f8876db None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.541785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e077515-a362-4af0-8122-736d8f8876db None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.542409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e077515-a362-4af0-8122-736d8f8876db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.557480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 277/531] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:00:47 2022] GET /identity/v3/role_assignments?user.id=36f0ee202c7946db8c77e1048d092fde&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:47.572929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:47.641595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:47.698295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e077515-a362-4af0-8122-736d8f8876db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:47.701097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e077515-a362-4af0-8122-736d8f8876db None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:47.841831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab7fa-86b3-4b7d-b7ad-ab8420d22f7d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:47.843511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:47.921754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ac4a7-ac8b-4499-953d-6a379e075698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:47.923362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac4a7-ac8b-4499-953d-6a379e075698 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.924227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac4a7-ac8b-4499-953d-6a379e075698 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.925187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac4a7-ac8b-4499-953d-6a379e075698 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.927050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ac4a7-ac8b-4499-953d-6a379e075698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:47.927938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ac4a7-ac8b-4499-953d-6a379e075698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:47.932354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ac4a7-ac8b-4499-953d-6a379e075698 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:47.940764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 255/532] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:47.940764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84b2ba-1d5b-4932-af3b-c4025e14f5a9 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.940764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84b2ba-1d5b-4932-af3b-c4025e14f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.940764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84b2ba-1d5b-4932-af3b-c4025e14f5a9 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.940764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 256/533] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:47.950460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84b2ba-1d5b-4932-af3b-c4025e14f5a9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:47.969418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 278/534] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:47.971261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdac8e-fdf7-4a91-9332-9793def70e95 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.972595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdac8e-fdf7-4a91-9332-9793def70e95 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.972595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdac8e-fdf7-4a91-9332-9793def70e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:48.017795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-eabdac8e-fdf7-4a91-9332-9793def70e95 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:48.019929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-eabdac8e-fdf7-4a91-9332-9793def70e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:48.205846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 279/535] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:48.208282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdac8e-fdf7-4a91-9332-9793def70e95 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:48.247038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:48.247766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84b2ba-1d5b-4932-af3b-c4025e14f5a9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:48.382176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:48.384915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:48.385642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:48.385827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:48.424261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdac8e-fdf7-4a91-9332-9793def70e95 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:48.438033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:48.440966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:48.496063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:48.497915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:48.499572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:48.499572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:48.499572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:48.503950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 257/536] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 555 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:48.516636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:48.518354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:48.520687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:48.526309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:48.529739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:48.562037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:48.568211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:48.579717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:00:48.619249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:48.620923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:48.622507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:48.627318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 280/537] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:48.641178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:48.909965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d40b6-3abe-4f53-8126-65bbaa549672 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:48.951763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:48.990645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:48.992513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:48.993113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:48.993610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:48.995365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:48.995914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:48.999215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:49.027872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 258/538] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:49.029599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:49.031549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8bc6-a8c0-4d7d-966b-a9df02a20578 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:49.137462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:49.139189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:49.140273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:49.141228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:49.142654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:49.143446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:49.146621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:49.176598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 281/539] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:49.178635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:49.213381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:49.281913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a4941-37b5-448f-b912-f6f1d442a2b3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:49.370009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:49.372141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:49.373038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:49.373751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:49.393529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ed221-da95-4748-a9d8-0d8a35d9bbe8 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:49.405412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:49.417220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:49.419127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:49.420801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:49.424830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 259/540] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:49.426848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:49.493914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:49.495649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:49.496506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:49.497323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:49.513452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:49.516778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:49.520910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:00:49.549417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:49.551053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:49.552700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:49.560154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 282/541] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:49.562300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:49.724225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f4c53-b12e-4483-a062-000e3e186af9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:49.797715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:49.808129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:49.819686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:49.819686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:49.819686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:49.819686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=fb8b75d3cf3b46a79706c74501dc874e) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:49.819686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:49.819686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:49.827071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd399f07-908f-4837-adb8-759b82bddc83 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:49.827927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 260/542] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:00:49 2022] GET /identity/v3/role_assignments?user.id=fb8b75d3cf3b46a79706c74501dc874e&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 259 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:49.829683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:49.918364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:49.920099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:49.920923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:49.921603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:49.922903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:49.923607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:49.926533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:49.943361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 283/543] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:49.954126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:50.113831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:50.144436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fbc6c-65eb-41df-ab6b-98a97c1e8d8e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:50.221322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee431d30-a26a-4d8f-8a8d-6b550d72266b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:50.236325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f49735-8380-4cd2-a545-ffa961963b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:50.237404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f49735-8380-4cd2-a545-ffa961963b29 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:50.237903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f49735-8380-4cd2-a545-ffa961963b29 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:50.238391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f49735-8380-4cd2-a545-ffa961963b29 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:50.239713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f49735-8380-4cd2-a545-ffa961963b29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:50.240319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f49735-8380-4cd2-a545-ffa961963b29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:50.243946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f49735-8380-4cd2-a545-ffa961963b29 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:50.270975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 261/544] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:50.273931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f344-1362-4900-a2d3-1e78a7e2aff0 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:50.274561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f344-1362-4900-a2d3-1e78a7e2aff0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:50.275339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f344-1362-4900-a2d3-1e78a7e2aff0 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:50.284929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 262/545] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:50.284929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f344-1362-4900-a2d3-1e78a7e2aff0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:50.341505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b98dc7-74d7-4d90-b802-a8f6154b94de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:50.341505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b98dc7-74d7-4d90-b802-a8f6154b94de None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:50.341505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b98dc7-74d7-4d90-b802-a8f6154b94de None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:50.342169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b98dc7-74d7-4d90-b802-a8f6154b94de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:50.366302 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b98dc7-74d7-4d90-b802-a8f6154b94de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:50.369606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b98dc7-74d7-4d90-b802-a8f6154b94de None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-f0b98dc7-74d7-4d90-b802-a8f6154b94de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:50.399063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:50.400917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:50.402666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:50.402666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:50.402666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:50.402666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 284/546] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:50.408922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26fd73-5848-487d-8ca0-347a15545a1c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:50.408922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26fd73-5848-487d-8ca0-347a15545a1c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:50.408922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26fd73-5848-487d-8ca0-347a15545a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:50.439053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-de26fd73-5848-487d-8ca0-347a15545a1c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:50.441757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-de26fd73-5848-487d-8ca0-347a15545a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:50.457166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:50.551442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f344-1362-4900-a2d3-1e78a7e2aff0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:50.625627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:50.626475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:50.626950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:50.627427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:50.629086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=9a588483344147629a6f557a54c34c83) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:50.629965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:50.634269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:50.650330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 263/547] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:00:50 2022] GET /identity/v3/role_assignments?user.id=9a588483344147629a6f557a54c34c83&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 259 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:50.653093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:50.659589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 285/548] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:50.947186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f742e-2b23-4931-b6a4-f0599ef3c426 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:50.993383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:51.031359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:51.032036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:51.032319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:51.032601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:51.033326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:51.033634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:51.035133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:51.061774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 264/549] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:51.071620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26fd73-5848-487d-8ca0-347a15545a1c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:51.189401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:51.239454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:51.309636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26fd73-5848-487d-8ca0-347a15545a1c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:51.379699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:51.380638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:51.381386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:51.381850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] PATH_INFO: `/v3/users/swift` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:51.398579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:51.400577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:51.430350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:51.431811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:00:51.433298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:51.437147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 286/550] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:00:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:51.441171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:51.658266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8253-858e-4931-b680-2df1bed7d540 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:51.701406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71579e-df58-4927-a0c8-db285c8a65af None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:51.705951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:51.780267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878bf27-6298-486e-97b2-711f87c5c7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:51.781259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878bf27-6298-486e-97b2-711f87c5c7a7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:51.781624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878bf27-6298-486e-97b2-711f87c5c7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:51.781970 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878bf27-6298-486e-97b2-711f87c5c7a7 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:51.783186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878bf27-6298-486e-97b2-711f87c5c7a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:51.783704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878bf27-6298-486e-97b2-711f87c5c7a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:51.785650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:51.786370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878bf27-6298-486e-97b2-711f87c5c7a7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:51.787441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:51.788199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:51.790008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:51.818567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:51.828243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:51.829972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:51.831542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:51.833702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 287/551] 10.222.0.71 () {56 vars in 1135 bytes} [Fri Sep 2 21:00:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:51.833702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4855f-93c8-4eaa-bcca-a5e037026eb7 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:51.833702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4855f-93c8-4eaa-bcca-a5e037026eb7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:51.833702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4855f-93c8-4eaa-bcca-a5e037026eb7 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:51.836004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 265/552] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 597 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:51.844840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 288/553] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:51.845296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:51.847427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4855f-93c8-4eaa-bcca-a5e037026eb7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:51.974984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:52.099357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4855f-93c8-4eaa-bcca-a5e037026eb7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:52.165186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d5e8-f414-41df-bf84-c829fad32097 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:52.178701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c65e-acac-4a1d-b055-ce8c76432549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:52.180987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c65e-acac-4a1d-b055-ce8c76432549 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:52.181824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c65e-acac-4a1d-b055-ce8c76432549 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:52.182617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c65e-acac-4a1d-b055-ce8c76432549 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:52.184217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c65e-acac-4a1d-b055-ce8c76432549 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:52.185215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c65e-acac-4a1d-b055-ce8c76432549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:52.188166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c65e-acac-4a1d-b055-ce8c76432549 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:52.205896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 289/554] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:52.208422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d68a42-8b94-4520-b59a-2e63c1d67d20 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:52.209301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d68a42-8b94-4520-b59a-2e63c1d67d20 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:52.210069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d68a42-8b94-4520-b59a-2e63c1d67d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:52.243106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a2d68a42-8b94-4520-b59a-2e63c1d67d20 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:52.244415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:52.245542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:52.246058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:52.246679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:52.247221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a2d68a42-8b94-4520-b59a-2e63c1d67d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:52.283382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:52.400123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 290/555] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:52.401708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d68a42-8b94-4520-b59a-2e63c1d67d20 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:52.407293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:52.412829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:52.502508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:52.635441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 266/556] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:52.643964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:52.783490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d68a42-8b94-4520-b59a-2e63c1d67d20 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:52.856368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:52.857957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:52.858416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:52.858860 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:52.883032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:52.885732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:52.918242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:52.919801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:52.922078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:52.922078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:52.922078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:52.922078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 291/557] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 519 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:52.930388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:52.939991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:53.026884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d268e-2afd-44e0-827f-ae0181a1ccbf None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:53.115287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:53.115889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.116314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.117519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.140428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:53.146442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:53.150495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:53.189012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:53.191406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:53.193087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:53.193087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:53.193087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:53.196831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 267/558] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 554 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:53.198754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:53.223246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5eff84-abe0-4318-ba34-70e2c1fb580c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:53.329292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:53.330902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.331781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.332572 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.334138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:53.334984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:53.339475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:53.369762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 292/559] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:53.371789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:53.452000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500da60-0d1a-4997-a8bf-01000663ee83 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:53.542159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:53.546414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:53.547226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.547500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.547826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.586586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:53.598082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:53.606380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 268/560] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:53.610034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:53.645017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b65e5-6246-4814-bbbd-2143a0b09789 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:53.720495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990d67-d70d-439a-808b-302cebd41781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:53.721472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990d67-d70d-439a-808b-302cebd41781 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.721948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990d67-d70d-439a-808b-302cebd41781 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.722538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990d67-d70d-439a-808b-302cebd41781 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.723716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990d67-d70d-439a-808b-302cebd41781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:53.724252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990d67-d70d-439a-808b-302cebd41781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:53.727354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990d67-d70d-439a-808b-302cebd41781 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:53.747920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:53.768784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 293/561] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:53.768784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba40b2-7865-43be-baf9-42d442b2ca72 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.768784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba40b2-7865-43be-baf9-42d442b2ca72 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.768784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba40b2-7865-43be-baf9-42d442b2ca72 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.773787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 294/562] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:53.775807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba40b2-7865-43be-baf9-42d442b2ca72 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:53.873589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319edfd-16a2-4613-8a45-1dcab97b8b04 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:53.950190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:53.951162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.951643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.952134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.969406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:53.972213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:53.994935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:53.996161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:53.997871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 269/563] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:53.999740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.035902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba40b2-7865-43be-baf9-42d442b2ca72 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.090181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.119440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370b6a3-bf40-4ce6-aed2-d662ff198391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.120390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b6a3-bf40-4ce6-aed2-d662ff198391 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.120876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b6a3-bf40-4ce6-aed2-d662ff198391 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.121313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b6a3-bf40-4ce6-aed2-d662ff198391 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.122339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370b6a3-bf40-4ce6-aed2-d662ff198391 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:54.122790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370b6a3-bf40-4ce6-aed2-d662ff198391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.124366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370b6a3-bf40-4ce6-aed2-d662ff198391 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.152610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 295/564] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:54.152610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6dc0d-c057-4cbe-990f-ccf55fc41a98 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.152610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6dc0d-c057-4cbe-990f-ccf55fc41a98 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.152610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6dc0d-c057-4cbe-990f-ccf55fc41a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.177664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-25e6dc0d-c057-4cbe-990f-ccf55fc41a98 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:54.180052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-25e6dc0d-c057-4cbe-990f-ccf55fc41a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:54.245962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed01b9-4a41-40cc-b1df-970b720dbfe6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.270399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.309618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 296/565] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:54.310467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.311041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6dc0d-c057-4cbe-990f-ccf55fc41a98 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.311212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.311779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.312189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.335173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.338465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:00:54.364803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:54.365819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:54.367242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:54.367714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 270/566] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:54.368829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.559062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6dc0d-c057-4cbe-990f-ccf55fc41a98 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.607176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.611966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c27e6f-dbd8-4634-a40d-3bc77107a73d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.653089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea599d-763c-45b7-ab94-0fae5fb94289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.654543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea599d-763c-45b7-ab94-0fae5fb94289 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.659413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea599d-763c-45b7-ab94-0fae5fb94289 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.660104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea599d-763c-45b7-ab94-0fae5fb94289 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.661527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea599d-763c-45b7-ab94-0fae5fb94289 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:54.662065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea599d-763c-45b7-ab94-0fae5fb94289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.666155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea599d-763c-45b7-ab94-0fae5fb94289 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.698746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.699784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.700241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.700694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.728813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.731493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:54.754520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:54.756591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:54.759249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:54.759249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:54.759249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:54.759596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 297/567] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:54.759596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a617e-a320-4a84-bbce-03f66bbd9898 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.759596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a617e-a320-4a84-bbce-03f66bbd9898 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.759596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a617e-a320-4a84-bbce-03f66bbd9898 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.761627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 298/568] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:54.762464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 271/569] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:54.762784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a617e-a320-4a84-bbce-03f66bbd9898 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.763382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.803326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.941220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc2ecd-0233-430a-84b6-dd1b38c66961 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.952424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a617e-a320-4a84-bbce-03f66bbd9898 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.994358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.995018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.995372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.995654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:55.010797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:55.016949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:55.019070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 272/570] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:55.020881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:55.039631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:55.040926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:55.041449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:55.041945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:55.043313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:55.043833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:55.046802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:55.071536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 299/571] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:55.073220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:55.147360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:55.165922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:55.200899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e2aa-6b3c-49c1-a5d6-3a552ec15bc2 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:55.274582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a221d-8b95-45b1-b65d-d40d656fa0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:55.275618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a221d-8b95-45b1-b65d-d40d656fa0db None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:55.276116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a221d-8b95-45b1-b65d-d40d656fa0db None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:55.276606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a221d-8b95-45b1-b65d-d40d656fa0db None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:55.277891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a221d-8b95-45b1-b65d-d40d656fa0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:55.278444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a221d-8b95-45b1-b65d-d40d656fa0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:55.281096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a221d-8b95-45b1-b65d-d40d656fa0db None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:55.285004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219400d-07af-40f5-868b-3f1a611e0e0b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:55.303751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 273/572] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:55.305180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908c0d-4655-443d-83a2-e65e1a6cbb01 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:55.305489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908c0d-4655-443d-83a2-e65e1a6cbb01 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:55.305761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908c0d-4655-443d-83a2-e65e1a6cbb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:55.332856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ec908c0d-4655-443d-83a2-e65e1a6cbb01 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:55.334685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ec908c0d-4655-443d-83a2-e65e1a6cbb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:55.356355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:55.357189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:55.357465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:55.357836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:55.384257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:55.393817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:55.421023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:55.422888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:55.424654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:55.424654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:55.424654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:55.424654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 300/573] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:55.424654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:55.493236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 274/574] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:55.494884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908c0d-4655-443d-83a2-e65e1a6cbb01 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:55.629210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:55.676901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a3b2-e4c6-41fe-9d24-0517ae4c806e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:55.690080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:55.755794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908c0d-4655-443d-83a2-e65e1a6cbb01 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:55.768159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:55.769520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:55.770169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:55.770777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:55.772201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:55.773015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:55.775849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:55.794755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 301/575] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:55.795556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:55.848446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:55.849683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:55.850261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:55.850765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:55.852270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=27594eb14cf742ce8bcf21cdb8db5ef6) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:55.852832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:55.855469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:55.867455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 275/576] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:00:55 2022] GET /identity/v3/role_assignments?user.id=27594eb14cf742ce8bcf21cdb8db5ef6&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:55.869169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:56.040132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b91a8-5681-4e5e-80a6-0a39cfce5052 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:56.113494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:56.114599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.115090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.115566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.131301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:56.133958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:56.134254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07133c-ccd5-477d-99f1-7cc4612dcff2 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:56.152449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:56.165207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 302/577] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:56.167199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:56.186322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:56.233543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:56.234272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.234617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.234974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.235770 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:56.236150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:56.238098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:56.251887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:56.266648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 276/578] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:56.268528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:56.415270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234cf91-3c61-4ad8-9470-4bf0838c97e3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:56.504663 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:56.506021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.506504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.508136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.515194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb038b2-638c-4d3a-905f-4c45acff8329 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:56.531188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:56.533893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:56.562376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:56.578010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:56.579226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:56.579226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:56.579226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:56.579226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 303/579] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:56.579226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:56.609121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:56.621377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.621377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.621377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.635290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:56.645634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:56.648421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:00:56.650646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:56.653336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 277/580] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:56.655436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:56.692802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:56.780824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:56.797410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb44f73-1977-4451-aa2f-6d17ef660c27 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:56.871025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:56.872230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.872482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.872804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e50c5-c5ed-4cf1-9471-7bbe43a9f272 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:56.873063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.874503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:56.875024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:56.877811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:56.926913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 304/581] 10.222.0.71 () {56 vars in 1137 bytes} [Fri Sep 2 21:00:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:56.928988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:56.935838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:56.937695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.937695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.937695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.951172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:56.953428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:00:56.970355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:56.972050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 278/582] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:56.973852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.149829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc376-285e-44ee-b54c-013912f18103 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.177008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ad4b-dad3-4d6b-b319-6e7292f0b482 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.197242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.212107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.240136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.241278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.244711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.244711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.244711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:57.244711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:57.247665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:57.249969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.251192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.251929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.252553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.254931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:57.255668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:57.259344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:57.280842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 305/583] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:57.280842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.292761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 279/584] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:00:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:57.292761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.513965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0debbc1-6351-4694-870c-0a71109332e4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.535180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e4ee-c29a-43a3-9788-31a1850696bb None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.596064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.597946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.599804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.599804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.613112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.614632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.615429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:57.615740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.616557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.618081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:57.619009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:57.619763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:57.622886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:57.645410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:57.647261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:57.649138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:57.649138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:57.649138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:57.649138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 306/585] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:57.649603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 280/586] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:57.650355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.653316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.718670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.757973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.872525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e90e2-de01-4b89-80b3-e6fafe773776 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.894678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9147a8-58bd-4841-a827-6cb6aaa0b897 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.944401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.946181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.948321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.948321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.973419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:57.975882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:57.982326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.983471 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.983920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.984391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:58.004286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:58.006188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:00:58.009104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:58.009711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.010881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.013018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 307/587] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:58.015316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:58.050587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:58.052440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:58.054079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:58.054079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:58.054079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:58.054079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 281/588] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:58.055496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.235307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.256591 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d7fe-2508-44f2-b761-47d766bd1372 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.303700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.325194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0be47-33cb-425c-9789-0e0e6fedb138 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.325637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568bfc-e968-421c-8cec-823755107139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.328320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568bfc-e968-421c-8cec-823755107139 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.329082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568bfc-e968-421c-8cec-823755107139 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.330014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568bfc-e968-421c-8cec-823755107139 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.331256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03568bfc-e968-421c-8cec-823755107139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:58.332014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03568bfc-e968-421c-8cec-823755107139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.334341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03568bfc-e968-421c-8cec-823755107139 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.363393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 308/589] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:58.367865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568bfc-e968-421c-8cec-823755107139 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.425190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.427256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.427961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.428673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a55753c439f54804814aca0a3feb96ed/roles/a71fb39654574349b08964577c193469` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.479179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=a55753c439f54804814aca0a3feb96ed, role_id=a71fb39654574349b08964577c193469)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.482773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.578586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 282/590] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:00:58 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a55753c439f54804814aca0a3feb96ed/roles/a71fb39654574349b08964577c193469 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:00:58.590390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568bfc-e968-421c-8cec-823755107139 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.591112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.706171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.708133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.715272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.715855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.717443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:58.722394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.722809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.772275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 309/591] 10.222.0.71 () {56 vars in 1137 bytes} [Fri Sep 2 21:00:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:58.774168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.808609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.895356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55229f-53a7-4dca-b021-dc246b00e70a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.978834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1ade8-d67d-4419-bac0-ed926e86e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.979894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1ade8-d67d-4419-bac0-ed926e86e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.980380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1ade8-d67d-4419-bac0-ed926e86e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.980885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1ade8-d67d-4419-bac0-ed926e86e6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.981961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1ade8-d67d-4419-bac0-ed926e86e6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:58.982492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1ade8-d67d-4419-bac0-ed926e86e6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.984581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1ade8-d67d-4419-bac0-ed926e86e6a0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.020795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 283/592] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:59.020795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de95ad-a4d2-48c5-b3e1-ef00ed0a8c5a None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.020795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de95ad-a4d2-48c5-b3e1-ef00ed0a8c5a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.020795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de95ad-a4d2-48c5-b3e1-ef00ed0a8c5a None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.021760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 284/593] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:00:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:59.024893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de95ad-a4d2-48c5-b3e1-ef00ed0a8c5a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.029227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:59.040084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93c07-912c-47a4-9cb7-7ddab2f3cb45 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:59.111946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:59.112930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.113349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.113784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.123989 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:59.125921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:00:59.145674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:59.147393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 310/594] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:59.149787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.323211 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de95ad-a4d2-48c5-b3e1-ef00ed0a8c5a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:59.339402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:59.408222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1709b88-fce6-44fc-9b9f-45ec0450f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:59.410495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709b88-fce6-44fc-9b9f-45ec0450f5aa None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.410495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709b88-fce6-44fc-9b9f-45ec0450f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.410495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709b88-fce6-44fc-9b9f-45ec0450f5aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.429957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aad0d7-09f4-4c6f-b957-2b9124e15e27 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:59.437539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1709b88-fce6-44fc-9b9f-45ec0450f5aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:59.440963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1709b88-fce6-44fc-9b9f-45ec0450f5aa None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-d1709b88-fce6-44fc-9b9f-45ec0450f5aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:59.477609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:59.479398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:59.482400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:59.482400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:59.482400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:00:59.482400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 285/595] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:59.482400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c92195-2f74-43d5-b6b4-a39b8fe91d0b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.483614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c92195-2f74-43d5-b6b4-a39b8fe91d0b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.483614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c92195-2f74-43d5-b6b4-a39b8fe91d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.517938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-70c92195-2f74-43d5-b6b4-a39b8fe91d0b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:59.519657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:59.520037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-70c92195-2f74-43d5-b6b4-a39b8fe91d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:59.520961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.521490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.521964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.537377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:59.540092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:00:59.569364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:59.571825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:00:59.574283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:00:59.579172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 311/596] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:00:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:59.580293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.654237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:59.683436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 286/597] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:59.684287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c92195-2f74-43d5-b6b4-a39b8fe91d0b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.844563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e92219-0fd9-4813-bc98-4d5f838e57e4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:59.902293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:59.922650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:59.927408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.927408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.927408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.927408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:59.927408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:59.929847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.963647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 312/598] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:59.964828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.996121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c92195-2f74-43d5-b6b4-a39b8fe91d0b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:00.078969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:00.080044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:00.080566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:00.081518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:00.082564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:00.083584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:00.087464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:00.129737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 287/599] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:00.131526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:00.232586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:00.245795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678db5e-7804-4bf5-b14d-2c2b50355310 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:00.321529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:00.322207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:00.322539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:00.322817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:00.323583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:00.323889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:00.325685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:00.344295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e3a37-2b9c-4cbc-b896-fd191798f1c8 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:00.356349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 313/600] 10.222.0.71 () {56 vars in 1139 bytes} [Fri Sep 2 21:00:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:00.357673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:00.400237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:00.400975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:00.401258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:00.401560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/36f0ee202c7946db8c77e1048d092fde/roles/a71fb39654574349b08964577c193469` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:00.424449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=36f0ee202c7946db8c77e1048d092fde, role_id=a71fb39654574349b08964577c193469)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:00.428022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:00.437097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:00.515164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fa65e-0f82-49c8-b18d-a27a39e79a4a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:00.559137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:00.560683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:00.561220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:00.561644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:00.571965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:00.585083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:00.590682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:00.592454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 314/601] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:00.594447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:00.713251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 288/602] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:00 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/36f0ee202c7946db8c77e1048d092fde/roles/a71fb39654574349b08964577c193469 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:00.715070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:00.848900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae18354-5172-4462-a0c1-3c70a8fc07e6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:00.869111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:00.934953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:00.937348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:00.938182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:00.939557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:00.963720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:00.971307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:00.981942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c83a1-9609-470f-9862-eb27890b1d20 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:00.984368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:00.986405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:00.988229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 315/603] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:00.990096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:01.061247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.063709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.064709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.065980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.102341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:01.106014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:01.141196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:01.143393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:01.145487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:01.145487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:01.145487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:01.149565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 289/604] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:01.151440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:01.244250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9889702-c183-4d8b-a1a3-e046cb7c051b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:01.324789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.326343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.327135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.327826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.329515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:01.330574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:01.333693 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:01.369256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 316/605] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:01.371304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:01.385597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953c640-efbc-400f-bdc0-0318b51ee174 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:01.439138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:01.455595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.456871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.460811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.460811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.460811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:01.460811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:01.463847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:01.486389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 290/606] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:01.488554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:01.516195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:01.573807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7385a-f52d-4db9-8e79-fb0c96747e72 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:01.656713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.657597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.657991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.658381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.659526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:01.660312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:01.663854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:01.682514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 317/607] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:01.683475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:01.752958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665c91f-6d54-4b9f-bb53-205a9bef4558 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:01.852578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fa502-ad7a-47e0-8c61-16b8b9871b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.855174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa502-ad7a-47e0-8c61-16b8b9871b3e None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.855174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa502-ad7a-47e0-8c61-16b8b9871b3e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.855174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa502-ad7a-47e0-8c61-16b8b9871b3e None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/fb8b75d3cf3b46a79706c74501dc874e/roles/a71fb39654574349b08964577c193469` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.888620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:01.889440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fa502-ad7a-47e0-8c61-16b8b9871b3e None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=fb8b75d3cf3b46a79706c74501dc874e, role_id=a71fb39654574349b08964577c193469)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:01.891590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fa502-ad7a-47e0-8c61-16b8b9871b3e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:01.925526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da334f-6c6c-4853-8c27-0c3eacbc9205 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:01.996767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.997857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.998285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.998570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.016961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.019708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:02.050814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:02.053605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:02.056540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:02.056540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:02.056540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:02.056540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 318/608] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:02.056540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.080148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 291/609] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:01 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/fb8b75d3cf3b46a79706c74501dc874e/roles/a71fb39654574349b08964577c193469 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:02.082604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405531b4-cfc5-43b4-ba6c-a35da3e3b702 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.083031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405531b4-cfc5-43b4-ba6c-a35da3e3b702 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.083462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405531b4-cfc5-43b4-ba6c-a35da3e3b702 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.088378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 292/610] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:02.089915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405531b4-cfc5-43b4-ba6c-a35da3e3b702 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.274413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:02.362233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd692f-2f8e-4424-846d-5a6763a5730e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.396716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405531b4-cfc5-43b4-ba6c-a35da3e3b702 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.468363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da5a8e-39b6-4671-8f8f-0e8475bf4d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.469598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5a8e-39b6-4671-8f8f-0e8475bf4d09 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.470140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5a8e-39b6-4671-8f8f-0e8475bf4d09 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.470710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5a8e-39b6-4671-8f8f-0e8475bf4d09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.479025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.480562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.481454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.482274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.483740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:02.484551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.486689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da5a8e-39b6-4671-8f8f-0e8475bf4d09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.487877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.489324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da5a8e-39b6-4671-8f8f-0e8475bf4d09 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.495513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-e2da5a8e-39b6-4671-8f8f-0e8475bf4d09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:02.508966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:02.510737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 319/611] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:02.512429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2003d6-aa44-4493-b708-f40d72462f73 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.515066 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2003d6-aa44-4493-b708-f40d72462f73 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.515066 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2003d6-aa44-4493-b708-f40d72462f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.527107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 293/612] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:02.529124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.543647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7a2003d6-aa44-4493-b708-f40d72462f73 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:02.543647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7a2003d6-aa44-4493-b708-f40d72462f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:02.661347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 320/613] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:02.663137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2003d6-aa44-4493-b708-f40d72462f73 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.709170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a13d-ec42-4b90-b836-99b86bb23636 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.740717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:02.787455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.788958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.789708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.790698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.791624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:02.792252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.795290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.833596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 294/614] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:02.838953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.913841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2003d6-aa44-4493-b708-f40d72462f73 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.977287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:03.000979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:03.003452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:03.006390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:03.007472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:03.032667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:03.035646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:03.064163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:03.066064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:03.067797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 321/615] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:03.079164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:03.155669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b97ad3-613a-49db-9a62-822a2f696336 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:03.293934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:03.295031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:03.295474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:03.295723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1eba4-cf49-41cd-9446-689f8293e303 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:03.295918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/9a588483344147629a6f557a54c34c83/roles/a71fb39654574349b08964577c193469` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:03.367021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:03.367891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:03.368326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:03.368500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=9a588483344147629a6f557a54c34c83, role_id=a71fb39654574349b08964577c193469)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:03.368886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:03.370137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:03.370633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:03.370974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:03.373420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:03.400676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 322/616] 10.222.0.71 () {56 vars in 1135 bytes} [Fri Sep 2 21:01:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:03.401595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:03.489420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 295/617] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:02 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/9a588483344147629a6f557a54c34c83/roles/a71fb39654574349b08964577c193469 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:01:03.491104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:03.526803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:03.570713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:03.650400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dac9b-636d-45f6-b4d7-e5511309a18b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:03.736691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:03.738264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:03.738720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:03.740153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:03.761239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:03.769732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:03.771548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:03.775965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:03.784770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 323/618] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:03.784770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:03.785649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd34da-9c21-4eff-af03-698a82fbf1ba None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:03.933049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:03.935565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:03.936081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:03.936704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:03.965001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:03.969278 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:04.004786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:04.006678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:04.009101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:04.009101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:04.009101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:04.012780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 296/619] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 520 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:04.023424 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:04.063195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca221e5-8463-42fc-a5b3-5bdf77f2ff0c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:04.099570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:04.175204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:04.176244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.176722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.177265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.178592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:04.179674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:04.182421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:04.211907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 324/620] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:04.220662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:04.311397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:04.358947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e31f-7fb2-40d6-b62c-e893e8a50820 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:04.458451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440f2bf-9288-4687-9b50-aa454fa5d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:04.460054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f2bf-9288-4687-9b50-aa454fa5d17d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.461287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f2bf-9288-4687-9b50-aa454fa5d17d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.462415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f2bf-9288-4687-9b50-aa454fa5d17d None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.463877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f2bf-9288-4687-9b50-aa454fa5d17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:04.464716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f2bf-9288-4687-9b50-aa454fa5d17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:04.467830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f2bf-9288-4687-9b50-aa454fa5d17d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:04.470534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca87829-fef1-4e77-bb6f-d879c9466fdd None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:04.496651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 297/621] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:04.497948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d6e0-4a7f-405b-acf5-0fb5f141ef3f None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.498478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d6e0-4a7f-405b-acf5-0fb5f141ef3f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.499688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d6e0-4a7f-405b-acf5-0fb5f141ef3f None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.507432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 298/622] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:04.507432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121d6e0-4a7f-405b-acf5-0fb5f141ef3f None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:04.560063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45466aa-38eb-4536-835d-8ea460547a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:04.565691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45466aa-38eb-4536-835d-8ea460547a8a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.565691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45466aa-38eb-4536-835d-8ea460547a8a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.565691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45466aa-38eb-4536-835d-8ea460547a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.588221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45466aa-38eb-4536-835d-8ea460547a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:04.591133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45466aa-38eb-4536-835d-8ea460547a8a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-b45466aa-38eb-4536-835d-8ea460547a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:04.620999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:04.622087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:04.623028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:04.623028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:04.623028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:04.623221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 325/623] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:04.625458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e04e-3537-4e25-b11a-47cad16004e5 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.625977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e04e-3537-4e25-b11a-47cad16004e5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.626483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e04e-3537-4e25-b11a-47cad16004e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.661934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b349e04e-3537-4e25-b11a-47cad16004e5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:04.664185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b349e04e-3537-4e25-b11a-47cad16004e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:04.696574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:04.708027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121d6e0-4a7f-405b-acf5-0fb5f141ef3f None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:04.778027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:04.779080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.779080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.779397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.790350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:04.793297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:04.797425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:04.812449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:04.819825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 299/624] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:04.823915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:04.843871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 326/625] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:04.846826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349e04e-3537-4e25-b11a-47cad16004e5 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:05.012365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b07c-47ca-4553-a64c-0b30e18a78c5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:05.077728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349e04e-3537-4e25-b11a-47cad16004e5 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:05.082964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:05.085904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:05.085904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:05.085904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:05.086659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:05.087108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:05.089813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:05.117291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 300/626] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:05.132380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:05.230548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:05.232138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:05.233067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:05.235887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:05.237628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:05.238485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:05.249161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:05.289311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 327/627] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:05.297619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:05.336867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:05.349346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:05.560104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c869-00bf-47af-b90f-b24f3242eb87 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:05.593318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956f24-9830-4d93-bec2-68c5070d18f6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:05.651210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:05.652330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:05.652850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:05.653324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:05.672213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:05.676140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:05.677441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:05.679020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:05.679871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:05.680974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/27594eb14cf742ce8bcf21cdb8db5ef6/roles/a71fb39654574349b08964577c193469` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:05.709079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=27594eb14cf742ce8bcf21cdb8db5ef6, role_id=a71fb39654574349b08964577c193469)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:05.712404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:05.720566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:05.722573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:05.724413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:05.729259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 301/628] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:01:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 599 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:05.730437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:05.822715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 328/629] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:05 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/27594eb14cf742ce8bcf21cdb8db5ef6/roles/a71fb39654574349b08964577c193469 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:05.823802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:06.008512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05618a-2f79-4c48-a32d-f541baa701b6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:06.030060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:06.061323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:06.097458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b60e9-72cf-403f-8d06-94717762a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:06.099110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b60e9-72cf-403f-8d06-94717762a85a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:06.099964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b60e9-72cf-403f-8d06-94717762a85a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:06.101604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b60e9-72cf-403f-8d06-94717762a85a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:06.122623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea799004-644b-4a9d-93f0-8daac3c1e254 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:06.128513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b60e9-72cf-403f-8d06-94717762a85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-f54b60e9-72cf-403f-8d06-94717762a85a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:06.142204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:06.144795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:06.146474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:06.151090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 302/630] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:06.153954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a11d-1930-4d17-a287-481dcfdf6ee1 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:06.154842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a11d-1930-4d17-a287-481dcfdf6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:06.155629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a11d-1930-4d17-a287-481dcfdf6ee1 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:06.158881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 303/631] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:06.162680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a11d-1930-4d17-a287-481dcfdf6ee1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:06.220575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbbf1d-a05a-45fb-932e-5e38639b2db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:06.222222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbbf1d-a05a-45fb-932e-5e38639b2db7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:06.223308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbbf1d-a05a-45fb-932e-5e38639b2db7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:06.224143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbbf1d-a05a-45fb-932e-5e38639b2db7 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:06.226615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbbf1d-a05a-45fb-932e-5e38639b2db7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:06.227748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbbf1d-a05a-45fb-932e-5e38639b2db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:06.231385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbbf1d-a05a-45fb-932e-5e38639b2db7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:06.279471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 329/632] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:01:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:06.284863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733525-da18-4738-a6e3-0ff257ece234 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:06.284863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733525-da18-4738-a6e3-0ff257ece234 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:06.284863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733525-da18-4738-a6e3-0ff257ece234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:06.319361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-bb733525-da18-4738-a6e3-0ff257ece234 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:06.322701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-bb733525-da18-4738-a6e3-0ff257ece234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:06.428208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a11d-1930-4d17-a287-481dcfdf6ee1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:06.495136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:06.496631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:06.496950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 330/633] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:06.497622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:06.498210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:06.498713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733525-da18-4738-a6e3-0ff257ece234 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:06.499790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:06.500629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:06.504371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:06.523726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 304/634] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:06.533669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:06.689526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:06.701238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:06.831196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733525-da18-4738-a6e3-0ff257ece234 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:06.898648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:06.900479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:06.901255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:06.902004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:06.978760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d4912-b498-4c50-82e1-96552ffffe29 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:07.031668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:07.035969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:07.092250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:07.093768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:07.094159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:07.094595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:07.122786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:07.125157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:07.157179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:07.159074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:07.161060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:07.161060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:07.161060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:07.161060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 305/635] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 627 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:07.161060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:07.169903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:07.306074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 331/636] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:07.306074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:07.360510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:07.375596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742dbc-2a94-432c-8784-58d919ed936a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:07.466913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:07.468067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:07.468566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:07.469093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:07.491651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:07.499852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:07.501493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:07.502710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:07.503825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ee857-f3c4-48b2-81f4-c1f2053224ab None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:07.506350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 306/637] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:07.508372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:07.594656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d15009-b6ae-4bcb-b8f6-d9dc916f2a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:07.595576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d15009-b6ae-4bcb-b8f6-d9dc916f2a29 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:07.596052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d15009-b6ae-4bcb-b8f6-d9dc916f2a29 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:07.596534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d15009-b6ae-4bcb-b8f6-d9dc916f2a29 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:07.597816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d15009-b6ae-4bcb-b8f6-d9dc916f2a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:07.598374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d15009-b6ae-4bcb-b8f6-d9dc916f2a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:07.601154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d15009-b6ae-4bcb-b8f6-d9dc916f2a29 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:07.630580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 332/638] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:07.633403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23e6e4-b8c9-4bfa-8d48-27c90eb63262 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:07.633843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23e6e4-b8c9-4bfa-8d48-27c90eb63262 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:07.634356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23e6e4-b8c9-4bfa-8d48-27c90eb63262 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:07.641405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 333/639] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:07.641405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23e6e4-b8c9-4bfa-8d48-27c90eb63262 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:07.665198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:07.702405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259589-d632-40bf-9fbd-e9ef5097eca4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:07.767443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:07.776147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:07.776590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:07.777068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:07.793538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:07.795095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:07.817094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:07.819922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:07.822190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:07.822190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:07.822190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:07.822190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 307/640] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:07.822190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:07.834228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:07.870213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23e6e4-b8c9-4bfa-8d48-27c90eb63262 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:07.935819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be01c6-1542-4853-bb62-7beea911cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:07.936816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be01c6-1542-4853-bb62-7beea911cc12 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:07.937376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be01c6-1542-4853-bb62-7beea911cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:07.937708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be01c6-1542-4853-bb62-7beea911cc12 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:07.938871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be01c6-1542-4853-bb62-7beea911cc12 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:07.939389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be01c6-1542-4853-bb62-7beea911cc12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:07.941856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be01c6-1542-4853-bb62-7beea911cc12 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:07.956796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 334/641] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:07.958412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea387a5-d765-4e81-8d1f-58bcf46e736b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:07.958829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea387a5-d765-4e81-8d1f-58bcf46e736b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:07.959206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea387a5-d765-4e81-8d1f-58bcf46e736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:07.987057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6ea387a5-d765-4e81-8d1f-58bcf46e736b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:07.989049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6ea387a5-d765-4e81-8d1f-58bcf46e736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:08.024979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5389b4-c1e4-4202-afc0-220dde96557b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:08.099171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:08.100168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.101564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.102129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.107878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:08.124888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:08.125173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 335/642] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:08.125173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea387a5-d765-4e81-8d1f-58bcf46e736b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:08.125450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:08.151893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:08.153784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:01:08.155751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:08.157159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 308/643] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:08.158350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:08.291297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:08.340062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea387a5-d765-4e81-8d1f-58bcf46e736b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:08.369865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c880d-9118-43de-b0df-d46e8c5fac50 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:08.422366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:08.423535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.424106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.424640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.426221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:08.426789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:08.430075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:08.441393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:08.444015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.445446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.446225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.460959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 336/644] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:08.462705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:08.472428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:08.476456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:08.511147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:08.513033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:08.514894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:08.514894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:08.514894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:08.516067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 309/645] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:08.517281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:08.592944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:08.658478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e683-a6af-4a6c-a0fb-867360cf68ec None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:08.725054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805297-f90f-4558-9da2-19023bc96d72 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:08.730016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:08.730725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.731084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.731422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.732347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:08.732717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:08.734500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:08.751989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:08.765007 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 337/646] 10.222.0.71 () {56 vars in 1137 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:08.766691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:08.783584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:08.784377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.784897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.785389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.794310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:08.795893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:08.810245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:08.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:08.812646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:08.816820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 310/647] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:08.817984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:08.906977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e39f1-06ee-4c0f-8278-58e499931be3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:08.930129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:08.960958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83af83-3916-4406-9355-b591baa8955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:08.961836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83af83-3916-4406-9355-b591baa8955f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.963256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83af83-3916-4406-9355-b591baa8955f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.963256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83af83-3916-4406-9355-b591baa8955f None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.963256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83af83-3916-4406-9355-b591baa8955f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:08.963754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83af83-3916-4406-9355-b591baa8955f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:08.965761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83af83-3916-4406-9355-b591baa8955f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:08.970833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713928e-3df8-4ee5-8dba-dac0fc2f9c47 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:08.987455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 338/648] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:08.987455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90af3-a0b5-46b9-825f-6e53c6bb3c7d None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.987455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90af3-a0b5-46b9-825f-6e53c6bb3c7d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.987455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90af3-a0b5-46b9-825f-6e53c6bb3c7d None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.987455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 339/649] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:08.988653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90af3-a0b5-46b9-825f-6e53c6bb3c7d None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.032882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.033755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.034127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.034405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.049235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:09.055451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:09.057482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 311/650] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:09.058520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.109281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.126701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90af3-a0b5-46b9-825f-6e53c6bb3c7d None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.175337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbc9a3-c240-4add-9ad0-ddf67dfdab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.176206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc9a3-c240-4add-9ad0-ddf67dfdab75 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.176529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc9a3-c240-4add-9ad0-ddf67dfdab75 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.177004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc9a3-c240-4add-9ad0-ddf67dfdab75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.189513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e29796-c0f9-4137-9e79-30576f27f6c5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.238103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.239305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.239655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.240038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.240826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:09.241648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.243259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.246599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.259360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 312/651] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.261477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.276163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbc9a3-c240-4add-9ad0-ddf67dfdab75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.278506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbc9a3-c240-4add-9ad0-ddf67dfdab75 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.415664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.421017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb666-83ac-40f9-91a9-0c5f949df47f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.441330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 340/652] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:09.443227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bffa1-32f2-4e49-b4ac-2ba6552a6878 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.443629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bffa1-32f2-4e49-b4ac-2ba6552a6878 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.444008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bffa1-32f2-4e49-b4ac-2ba6552a6878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.465699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-828bffa1-32f2-4e49-b4ac-2ba6552a6878 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:09.467129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-828bffa1-32f2-4e49-b4ac-2ba6552a6878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:09.473400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.474217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.474994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.474994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.486030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.487683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:09.503295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:09.505664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 313/653] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:09.507706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.578446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 341/654] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:09.579833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bffa1-32f2-4e49-b4ac-2ba6552a6878 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.605856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.677027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0574b-29b2-4714-ad02-472f6e85b554 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.734072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.734704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.734992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.735259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.735947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:09.736765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.737732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.752081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 314/655] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.759104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.790850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bffa1-32f2-4e49-b4ac-2ba6552a6878 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.807993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.859425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.860974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.861751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.862565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.865022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a55753c439f54804814aca0a3feb96ed) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:09.865872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.869531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.880649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 342/656] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/role_assignments?user.id=a55753c439f54804814aca0a3feb96ed&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.883538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.965032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098bf48-db3f-4f06-a7f3-62ce2531f027 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.987918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.040277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4168-6973-4cce-a65b-229b06dc3839 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.040559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.041671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.042486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.042970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.067419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.070395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:10.093496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:10.096665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:10.098631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:10.098631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:10.098631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:10.098631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 315/657] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:10.098631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.129431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.130894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.131445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.131818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.132878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:10.133448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.136003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.171954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 343/658] 10.222.0.71 () {56 vars in 1137 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:10.172888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.256427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.318882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e0df9-cc3d-4a76-acea-b57456707053 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.341321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e557-d4a9-445a-b121-81f94baddc92 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.385672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.386691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.386996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.387252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.391016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.409862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.411384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.412220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.412539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.413515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.414482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:10.437929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:10.439854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:10.441792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:10.441792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:10.441792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:10.442139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:10.445470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 316/659] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:10.446410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:10.449087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:10.451807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:10.453625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:10.458108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 344/660] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:10.461553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.663934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2ef5f-6a73-40bc-9bc7-16d4376234ea None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.684972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755b8c1-afdd-4fc5-b519-eb473441d610 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.719502 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.743342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.747885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.747885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.747885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.747885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:10.747885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.749153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.775861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 317/661] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:10.775861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.787187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.789353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.790068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.790503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.907076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.932718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.935570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.971753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf21a6-f756-4532-b27f-a083fa1d42e4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.035948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.037996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.038496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.038984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.040194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:11.040781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.043691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.071318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 318/662] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:11.071318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.144189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 345/663] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:11.146381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.174884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.274128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa81cb-9b84-4341-89a2-1eb78f0fd3a7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.290323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.304317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00fab2-1ef2-423a-bbad-d55155dae61a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.337521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.338819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.339365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.339837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.341031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:11.341516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.343896 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.361571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 319/664] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:11.361821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.362361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.362956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.363316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.366389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.375493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.377851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:11.395305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:11.397060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 346/665] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:11.401623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.576676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd1d99-241a-4abc-8b11-a1e23965c0ca None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.590472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.605127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b367446-4fda-42db-bf59-e937fba300f3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.639201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.640953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.641323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.641854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.657581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.660517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.660893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.661516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.661900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.662536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.683240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.686289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:11.691094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:11.698952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 320/666] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:11.703116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:11.726404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:11.728220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:11.730932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:11.730932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:11.730932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:11.730932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 347/667] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:11.730932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.732480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.965027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843ab28-c53f-435f-8e70-2fbc2b784b21 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.967168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba776a-e449-4759-983b-960e4189edaa None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:12.040995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.042080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.042563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.043176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:12.044346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:12.044921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:12.045882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.046982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.047454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.047776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:12.047891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:12.073400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:12.076476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:12.081981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 348/668] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:12.082510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:12.122723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:12.125574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:12.127317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:12.127317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:12.127317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:12.134348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 321/669] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:12.135843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:12.181237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:12.240196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:12.324775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b61a9b-fc56-49bc-b817-9ebd9bf9bce1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:12.364157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05d4e4-da8f-4712-b6dc-d3f335f42507 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:12.377615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.378664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.379446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.379938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:12.381418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:12.381998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:12.384837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:12.406244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.407145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.407593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.407864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:12.408578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:12.409097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:12.410862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:12.414379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 349/670] 10.222.0.71 () {56 vars in 1139 bytes} [Fri Sep 2 21:01:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:12.421741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:12.438596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 322/671] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:12.452165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:12.570218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee5a0-59d7-41c4-b2e3-11d26d516dc3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:12.577711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:12.608414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:12.626052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70e359-214c-4e63-8457-aff55635dbb8 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:12.653057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.653875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.654369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.654899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:12.656301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=36f0ee202c7946db8c77e1048d092fde) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:12.656883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:12.659303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:12.669006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 350/672] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:12 2022] GET /identity/v3/role_assignments?user.id=36f0ee202c7946db8c77e1048d092fde&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:12.670682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:12.690136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478792e-228f-47d3-9560-074f86074656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.691102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478792e-228f-47d3-9560-074f86074656 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.691592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478792e-228f-47d3-9560-074f86074656 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.692924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478792e-228f-47d3-9560-074f86074656 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:12.695174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478792e-228f-47d3-9560-074f86074656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:12.695696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478792e-228f-47d3-9560-074f86074656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:12.697748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478792e-228f-47d3-9560-074f86074656 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:12.723009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 323/673] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:12.725645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478792e-228f-47d3-9560-074f86074656 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:12.867040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710f85-2dee-4a09-a868-aa2f6baea5b6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:12.923874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478792e-228f-47d3-9560-074f86074656 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:12.925214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6d4d6-8739-4a74-b602-04aa5c9c67f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.926054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6d4d6-8739-4a74-b602-04aa5c9c67f2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.926484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6d4d6-8739-4a74-b602-04aa5c9c67f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.927122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6d4d6-8739-4a74-b602-04aa5c9c67f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:12.995770 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:12.996710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:12.997233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:12.997931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.013651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:13.015581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:13.019604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:13.033216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:13.033848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:13.035753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 324/674] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:13.043910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:13.070804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6d4d6-8739-4a74-b602-04aa5c9c67f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:13.073285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6d4d6-8739-4a74-b602-04aa5c9c67f2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:13.235147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d62d4-1737-40b5-ae8f-ae5af6506699 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:13.246650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 351/675] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:13.249398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d63ef-fffb-4f2b-bc4f-2f0cd42c8447 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.249803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d63ef-fffb-4f2b-bc4f-2f0cd42c8447 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.250159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d63ef-fffb-4f2b-bc4f-2f0cd42c8447 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.252468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 352/676] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:13.254565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d63ef-fffb-4f2b-bc4f-2f0cd42c8447 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:13.327645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:13.328771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.329208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.330436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] PATH_INFO: `/v3/users/swift` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.343882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:13.345450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:13.363438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:13.364577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 325/677] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:13.369282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:13.446636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:13.489553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:13.491321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d63ef-fffb-4f2b-bc4f-2f0cd42c8447 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:13.573220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c901f36-665f-4ddd-85c7-44f8591ce5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:13.573686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a45a-7b19-4bd2-8d8a-9d76ef31642b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:13.574491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c901f36-665f-4ddd-85c7-44f8591ce5f3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.574996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c901f36-665f-4ddd-85c7-44f8591ce5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.575501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c901f36-665f-4ddd-85c7-44f8591ce5f3 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.576873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c901f36-665f-4ddd-85c7-44f8591ce5f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:13.577438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c901f36-665f-4ddd-85c7-44f8591ce5f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:13.580360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c901f36-665f-4ddd-85c7-44f8591ce5f3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:13.609994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 353/678] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:13.612349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c807640-0477-4fab-b09f-c8f6fde4a2b2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.613083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c807640-0477-4fab-b09f-c8f6fde4a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.613377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c807640-0477-4fab-b09f-c8f6fde4a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.645360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6c807640-0477-4fab-b09f-c8f6fde4a2b2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:13.648263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6c807640-0477-4fab-b09f-c8f6fde4a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:13.650768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:13.652202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.652719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.653247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.672431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:13.674899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:13.708433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:13.710929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:13.712006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:13.712006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:13.712006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:13.712006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 326/679] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:13.712006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:13.800868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 354/680] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:13.802272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c807640-0477-4fab-b09f-c8f6fde4a2b2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:13.952539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ab970-429c-49ef-a0c1-4480a9e16ad0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:13.972398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.013321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.020064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:14.021694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.022876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.032760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.032760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:14.032760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:14.032760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:14.065512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 327/681] 10.222.0.71 () {56 vars in 1135 bytes} [Fri Sep 2 21:01:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:14.067394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.067867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c807640-0477-4fab-b09f-c8f6fde4a2b2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:14.161382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:14.162460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.163581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.164204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.166882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=fb8b75d3cf3b46a79706c74501dc874e) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:14.167515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:14.171919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:14.196168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 355/682] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:13 2022] GET /identity/v3/role_assignments?user.id=fb8b75d3cf3b46a79706c74501dc874e&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 608 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:14.198448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.335867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74e35d-2708-46b8-a721-cf82ab0788c9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:14.402325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:14.403191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.403661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.404147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.405729 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:14.406215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:14.408442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:14.434922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 328/683] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:14.435883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.489584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.500111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b0642-5371-4815-ad08-36d3722232c3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:14.569900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:14.571966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.572459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.572908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.599258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.660843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6df5d-d7c1-463e-a03d-2afd79ea9761 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:14.712064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:14.712859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.713227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.713408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.728019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:14.729067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:14.732661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:14.733538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:14.735305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 329/684] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:14.736816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.861305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.884282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef97cf-bea9-4390-8224-ccf5087c2e41 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:14.947057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 356/685] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:14.948383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.961522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:14.962678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.963174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.968336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.984441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:14.987308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:15.013307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:15.015037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:15.016642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:15.024239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 330/686] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:15.026003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.033114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.150507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677b2bf-e150-42a7-a909-41855da1e40c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.210187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.211047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.211527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.211869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.212838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:15.213217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.214749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.226996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 357/687] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.228169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.275850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33400d3-e233-43a4-bcca-e639bf2b3348 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.344073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.345269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.345730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.346180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.369208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.372124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.394651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.400820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.409308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab837d77-bd6b-45dd-8403-be1b8ef63bb5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:15.413064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:15.415318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:15.417399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:15.417399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:15.417399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:15.417399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 331/688] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:15.417399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.497951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.498952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.499387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.499864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.500952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:15.501316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.503040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.527183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 358/689] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.528432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.636658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed09a97-024f-412c-8a3a-4d06090255e1 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.706687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.708829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.709614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.710419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.726969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979396e5-6390-4600-abba-cf4c4f8c5a91 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.733445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.736372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:15.772779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:15.774549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:15.775707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:15.775707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:15.775707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:15.775707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 332/690] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:15.775707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.796268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9aa9c-1a78-4558-b40c-50c868653f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.796950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9aa9c-1a78-4558-b40c-50c868653f68 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.797204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9aa9c-1a78-4558-b40c-50c868653f68 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.797468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9aa9c-1a78-4558-b40c-50c868653f68 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.800805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9aa9c-1a78-4558-b40c-50c868653f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:15.800805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9aa9c-1a78-4558-b40c-50c868653f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.800805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9aa9c-1a78-4558-b40c-50c868653f68 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.831164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 359/691] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.831164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41004f-c477-4733-b596-54e87bb69f98 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.831164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41004f-c477-4733-b596-54e87bb69f98 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.831164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41004f-c477-4733-b596-54e87bb69f98 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.831164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 360/692] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:15.831164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41004f-c477-4733-b596-54e87bb69f98 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.878283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.907742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.996172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c2f4-ee04-41b3-b57e-7b9d0a829fe5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.060570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41004f-c477-4733-b596-54e87bb69f98 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.083351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.084043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.084362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.084883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.087234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=9a588483344147629a6f557a54c34c83) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:16.087908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.090704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.114112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 333/693] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/role_assignments?user.id=9a588483344147629a6f557a54c34c83&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.115602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.151740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9aa495-2385-43ce-a4ad-c8329db708e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.152974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9aa495-2385-43ce-a4ad-c8329db708e3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.153517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9aa495-2385-43ce-a4ad-c8329db708e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.153910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9aa495-2385-43ce-a4ad-c8329db708e3 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.155351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9aa495-2385-43ce-a4ad-c8329db708e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:16.155820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9aa495-2385-43ce-a4ad-c8329db708e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.158424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9aa495-2385-43ce-a4ad-c8329db708e3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.213160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 361/694] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.215105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644b4b1-6fb9-4182-a5b2-a1a652b102e4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.215503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644b4b1-6fb9-4182-a5b2-a1a652b102e4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.215815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644b4b1-6fb9-4182-a5b2-a1a652b102e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.257173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b644b4b1-6fb9-4182-a5b2-a1a652b102e4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:16.258588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b644b4b1-6fb9-4182-a5b2-a1a652b102e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:16.342899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4545b-2e15-4463-8f8d-c2274b497c90 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.376616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.414405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.415592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.415913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.416212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.427333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.429219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.439965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 362/695] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:16.441950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644b4b1-6fb9-4182-a5b2-a1a652b102e4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:16.458550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:16.460754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:16.462365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:16.468779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 334/696] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:16.472590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.479768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.671835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644b4b1-6fb9-4182-a5b2-a1a652b102e4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.749415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16441d-d0b6-4372-bac6-d4499fa841ee None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.756779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.757869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.758431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.758974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.779927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.789666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:16.812351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:16.813871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:16.815080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:16.819051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 363/697] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:16.828023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.854892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.855994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.856480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.857000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.858350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:16.858891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.861952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.893199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 335/698] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.900239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.992172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.994017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.047703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ace5d5-7a8f-4f28-b60d-1291ec804cf1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.114543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.115535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.116083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.116556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.118392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:17.119655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.122904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.124317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8964f-e324-404b-9f8b-414c7f2d8f40 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.168168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 364/699] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:17.169714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.200522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.201778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.202353 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.202924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.204418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=27594eb14cf742ce8bcf21cdb8db5ef6) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:17.205174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.208280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.228970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 336/700] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/role_assignments?user.id=27594eb14cf742ce8bcf21cdb8db5ef6&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:17.230786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.390760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700397ac-65b2-4fdf-a469-dc3360f13483 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.461939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.498097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.499441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.499927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.500431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.556662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.557214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.599528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f9e1-d2cd-43a9-9b7b-0e1098423dd4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:17.612896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:17.617052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:17.620691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:17.620691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:17.620691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:17.620691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 365/701] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:17.630846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.635061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.733954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592a6d8-9f88-48e4-a79f-41590911aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.735133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a6d8-9f88-48e4-a79f-41590911aa09 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.735663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a6d8-9f88-48e4-a79f-41590911aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.736184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592a6d8-9f88-48e4-a79f-41590911aa09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.902446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592a6d8-9f88-48e4-a79f-41590911aa09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.905312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592a6d8-9f88-48e4-a79f-41590911aa09 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.914344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6972ca-e69f-4116-b731-053cc4b3020b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.988453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.989442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.989930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.990417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.991759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:17.992244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.994730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:18.025162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 366/702] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:18.039922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:18.156378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:18.163786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:18.170536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 337/703] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 941 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:18.177422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3e2e-0ef0-4bf8-959f-5ace3d2d6be7 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:18.180075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3e2e-0ef0-4bf8-959f-5ace3d2d6be7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:18.181102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3e2e-0ef0-4bf8-959f-5ace3d2d6be7 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:18.184879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 338/704] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:18.191134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3e2e-0ef0-4bf8-959f-5ace3d2d6be7 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:18.311966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983854f-1f26-4394-a58e-3b6bde1e1ee9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:18.403143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7b7a7-a020-4e16-bc85-2d96e7844a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:18.404509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7b7a7-a020-4e16-bc85-2d96e7844a9d None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:18.405353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7b7a7-a020-4e16-bc85-2d96e7844a9d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:18.406200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7b7a7-a020-4e16-bc85-2d96e7844a9d None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:18.407705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7b7a7-a020-4e16-bc85-2d96e7844a9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:18.410744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7b7a7-a020-4e16-bc85-2d96e7844a9d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:18.479729 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3e2e-0ef0-4bf8-959f-5ace3d2d6be7 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:18.551958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 367/705] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:18 2022] POST /identity/v3/users => generated 254 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:01:18.555679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9acef-08a1-4f12-9e05-b5cd84f3b3fa None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:18.562210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9acef-08a1-4f12-9e05-b5cd84f3b3fa None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:18.562210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9acef-08a1-4f12-9e05-b5cd84f3b3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:18.578961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:18.578961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:18.578961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:18.578961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:18.604450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-38b9acef-08a1-4f12-9e05-b5cd84f3b3fa None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:18.606277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-38b9acef-08a1-4f12-9e05-b5cd84f3b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:18.616233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:18.618931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:18.668761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:18.670487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:18.672094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:18.672094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:18.672094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:18.681483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 339/706] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:18.690056 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:18.832173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:18.870249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 368/707] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:18.947284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413791e3-585f-4bde-b68b-ea38480e44fe None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:19.019289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:19.020295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:19.020809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:19.021295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:19.023151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:19.023688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:19.026338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:19.052559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 340/708] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:19.061859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9acef-08a1-4f12-9e05-b5cd84f3b3fa None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:19.129725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:19.318574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9acef-08a1-4f12-9e05-b5cd84f3b3fa None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:19.388758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:19.389403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:19.389686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:19.389963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:19.404703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:19.406491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:19.425197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:19.427466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:19.430026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 369/709] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:19.435700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:19.478560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:19.651061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbb400-cff0-4e89-87bd-ae7a233e26aa None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:19.672225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:19.697195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:19.722535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6e021-5f09-4dff-a7b6-f364987dcd85 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:19.727397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:19.728789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:19.728789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:19.728789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:19.729554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:19.729859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:19.731558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:19.763141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 341/710] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:19.782499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:19.799767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:19.801005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:19.801620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:19.802122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:19.802940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:19.804802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:19.819712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:19.821528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:19.822389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:19.825529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 370/711] 10.222.0.71 () {56 vars in 1129 bytes} [Fri Sep 2 21:01:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:19.832332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.055047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170564-f65f-4c29-9635-d2487a52cc7f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:20.123830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1b7a4-7529-4807-92ce-67013cf8e67c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:20.131480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351774f-d26e-4ad5-887a-ff548205a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:20.132539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351774f-d26e-4ad5-887a-ff548205a112 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.133065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351774f-d26e-4ad5-887a-ff548205a112 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.133638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351774f-d26e-4ad5-887a-ff548205a112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.135030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351774f-d26e-4ad5-887a-ff548205a112 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a55753c439f54804814aca0a3feb96ed) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:20.135573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351774f-d26e-4ad5-887a-ff548205a112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:20.138277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351774f-d26e-4ad5-887a-ff548205a112 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:20.149681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 342/712] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:19 2022] GET /identity/v3/role_assignments?user.id=a55753c439f54804814aca0a3feb96ed&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:20.152097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef64f80-4794-46f2-b926-2dd620aabe06 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.152594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef64f80-4794-46f2-b926-2dd620aabe06 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.153142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef64f80-4794-46f2-b926-2dd620aabe06 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.156262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 343/713] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:20.162192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4853972-9b78-4e46-bf14-451685616493 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.163410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4853972-9b78-4e46-bf14-451685616493 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.164019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4853972-9b78-4e46-bf14-451685616493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.192179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a4853972-9b78-4e46-bf14-451685616493 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:20.195933 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a4853972-9b78-4e46-bf14-451685616493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:20.225395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:20.226547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.227113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.227691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.228658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:20.229602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:20.231338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:20.249682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 371/714] 10.222.0.71 () {56 vars in 1124 bytes} [Fri Sep 2 21:01:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:20.260942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.289395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:20.307513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:20.417902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 344/715] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:20.535131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018affff-bdf5-4cf7-8ffb-d2920f701f31 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:20.614773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:20.615781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.616817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.617318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.618552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:20.619529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:20.622236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:20.639415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 372/716] 10.222.0.71 () {56 vars in 1124 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:20.872261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4853972-9b78-4e46-bf14-451685616493 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.103151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4853972-9b78-4e46-bf14-451685616493 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.184962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddff0f-898a-46b0-a1cb-9f73bb247e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.186017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddff0f-898a-46b0-a1cb-9f73bb247e2a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.186517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddff0f-898a-46b0-a1cb-9f73bb247e2a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.187008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddff0f-898a-46b0-a1cb-9f73bb247e2a None admin] PATH_INFO: `/v3/services/network` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.188351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddff0f-898a-46b0-a1cb-9f73bb247e2a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:21.191045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddff0f-898a-46b0-a1cb-9f73bb247e2a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-2dddff0f-898a-46b0-a1cb-9f73bb247e2a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:21.213388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:21.215487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:21.217143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 345/717] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:21.235293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.476999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:21.544661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874177a6-50d7-4eda-8741-96f323bba0d9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.646497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.648193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.649055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.649817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.651639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] RBAC: Adding query filter params (name=network) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:21.652525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:21.655626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:21.671741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 373/718] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:01:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:21.677713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af839-3441-4d04-b46d-8e8c3d1c6810 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.678771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af839-3441-4d04-b46d-8e8c3d1c6810 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.679268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af839-3441-4d04-b46d-8e8c3d1c6810 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.682298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.689123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 346/719] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:21.692171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799af8-97bc-42bf-b13c-ad640a2d6366 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.692671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799af8-97bc-42bf-b13c-ad640a2d6366 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.693224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799af8-97bc-42bf-b13c-ad640a2d6366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.934072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-95799af8-97bc-42bf-b13c-ad640a2d6366 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:21.936463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-95799af8-97bc-42bf-b13c-ad640a2d6366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:21.999146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:22.096362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4607b3-e503-4751-88cc-82c517eefe72 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:22.120407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 347/720] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:22.183464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:22.185042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:22.185652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:22.186276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:22.187653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] RBAC: Adding query filter params (type=network) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:22.188345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:22.191116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:22.203315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 374/721] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:01:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:22.691282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95799af8-97bc-42bf-b13c-ad640a2d6366 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.905955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95799af8-97bc-42bf-b13c-ad640a2d6366 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.004576 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49c50-b6a7-47bd-bda2-48f01ce0144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.005748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49c50-b6a7-47bd-bda2-48f01ce0144e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.006806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49c50-b6a7-47bd-bda2-48f01ce0144e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.008304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49c50-b6a7-47bd-bda2-48f01ce0144e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.038395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49c50-b6a7-47bd-bda2-48f01ce0144e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-1fc49c50-b6a7-47bd-bda2-48f01ce0144e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:23.044076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:23.045834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:23.047433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 348/722] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:23.059826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.085891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.201676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c978e-d25c-4dd1-bf1f-0f6c76f3e54c None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.201676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c978e-d25c-4dd1-bf1f-0f6c76f3e54c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.201676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c978e-d25c-4dd1-bf1f-0f6c76f3e54c None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.202906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 349/723] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:23.210122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0d0a4-c59f-496f-9d90-6cec2b0b707f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.210960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0d0a4-c59f-496f-9d90-6cec2b0b707f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.211540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0d0a4-c59f-496f-9d90-6cec2b0b707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.253981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-eaa0d0a4-c59f-496f-9d90-6cec2b0b707f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:23.255672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-eaa0d0a4-c59f-496f-9d90-6cec2b0b707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:23.286101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.317466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310373e3-8555-442d-875f-6eef8505fd7b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.365165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 350/724] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:23.410403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.411081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.411361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.411634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.412328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:23.412717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.414905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.437730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 375/725] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:23.447037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0d0a4-c59f-496f-9d90-6cec2b0b707f None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.651895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0d0a4-c59f-496f-9d90-6cec2b0b707f None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.698929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b424886-d2f8-4fed-b6c0-7de2b551ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.699591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b424886-d2f8-4fed-b6c0-7de2b551ec50 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.699874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b424886-d2f8-4fed-b6c0-7de2b551ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.700150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b424886-d2f8-4fed-b6c0-7de2b551ec50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.715434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b424886-d2f8-4fed-b6c0-7de2b551ec50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.717179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b424886-d2f8-4fed-b6c0-7de2b551ec50 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-5b424886-d2f8-4fed-b6c0-7de2b551ec50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:23.737219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:23.738271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:23.739166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:23.739166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:23.739166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:23.739166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 351/726] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:23.745683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.885397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.933315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af53a-628b-4bae-8e26-81fb701db700 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.009890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.011525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.012328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.013125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.014691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:24.016002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.018329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a14a6-01fe-4fde-8a3d-925ce27ed1b2 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.018965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a14a6-01fe-4fde-8a3d-925ce27ed1b2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.019279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.019674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a14a6-01fe-4fde-8a3d-925ce27ed1b2 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.021683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 352/727] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:24.030797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b11f-2ba0-401e-a99b-f9daf3f558d4 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.031643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b11f-2ba0-401e-a99b-f9daf3f558d4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.032433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b11f-2ba0-401e-a99b-f9daf3f558d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.046450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.049125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 376/728] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:24.050734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.088202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8331b11f-2ba0-401e-a99b-f9daf3f558d4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:24.091249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8331b11f-2ba0-401e-a99b-f9daf3f558d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:24.245450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 353/729] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:24.247246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b11f-2ba0-401e-a99b-f9daf3f558d4 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.260142 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7007570-eaeb-4671-a593-91d0ddcf32d6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.338367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.358180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.359424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.362438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.364695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.395700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:24.407210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:24.408959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:24.410447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:24.412975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 377/730] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:24.422685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.492281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b11f-2ba0-401e-a99b-f9daf3f558d4 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.573232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.584228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8619e8-a744-43be-a60f-397e4a2f2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.585756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8619e8-a744-43be-a60f-397e4a2f2c89 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.586188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8619e8-a744-43be-a60f-397e4a2f2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.586634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8619e8-a744-43be-a60f-397e4a2f2c89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.602651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8619e8-a744-43be-a60f-397e4a2f2c89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.605464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8619e8-a744-43be-a60f-397e4a2f2c89 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9f8619e8-a744-43be-a60f-397e4a2f2c89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:24.632462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:24.634546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:24.636669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:24.639234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 354/731] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:24.645059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba029-2b29-48ec-bcf2-2fbc8f6a9b23 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.645059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba029-2b29-48ec-bcf2-2fbc8f6a9b23 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.645059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba029-2b29-48ec-bcf2-2fbc8f6a9b23 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.645059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 355/732] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:24.655526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b255fb-c2ee-48d3-beea-fd4f401df1d5 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.656662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b255fb-c2ee-48d3-beea-fd4f401df1d5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.657201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b255fb-c2ee-48d3-beea-fd4f401df1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.696658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-85b255fb-c2ee-48d3-beea-fd4f401df1d5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:24.700034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-85b255fb-c2ee-48d3-beea-fd4f401df1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:24.715760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ef322-751c-4e2d-8c3e-4cac278d45df None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.795795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.797056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.797600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.798124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.799341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:24.799993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.802476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.823482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 378/733] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:24.823482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.840930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 356/734] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:24.845859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b255fb-c2ee-48d3-beea-fd4f401df1d5 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.933259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.022060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c7f05-196d-4f79-b239-b467b2dc6c54 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.040398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b255fb-c2ee-48d3-beea-fd4f401df1d5 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.079713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.095885 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.097370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.097961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.098455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.148965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.149142 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:25.149227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.149298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.149376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.149376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.149553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:25.149623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:25.150366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:25.151361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 357/735] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:25.152149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.154644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 379/736] 10.222.0.71 () {56 vars in 1135 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:25.156371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.304327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300c3e-df56-45d6-a0e6-173052c4096b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.321292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.350744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c622d-09c3-407b-83e5-f061960eff96 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.366998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.368063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.368568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.369030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.370245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:25.370838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.373620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.392813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 380/737] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:25.393316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.408556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.409651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.410182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.410619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.426481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.429381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:25.460929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:25.462782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:25.473108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:25.473108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:25.473108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:25.473108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 358/738] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:25.473108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.526843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.582352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409cdcf-0b75-4bd3-a1cf-edcf0e30d162 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.637706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.638635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.638921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.639196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.681119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e77d0-c119-4b69-b5b7-4ec74fa6cfca None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.732213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.768142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.769173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.769396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.769749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.770479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.772600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.797455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.800476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.009155 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 359/739] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:01:25 2022] POST /identity/v3/services => generated 251 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:26.015790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.065353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 381/740] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:26.067284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.340416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.394554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.440928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f018b9-77d3-4d0d-b1a9-b21dbd737d7d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.457070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17995-d6ea-4fca-b656-1b37ed8dda02 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.513032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.514956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.515791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.516523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.518069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:26.518855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.521896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.549053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 382/741] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:26.551088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.559296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f512f27-600b-4fd4-9fd5-1dd4400dfaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.560404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f512f27-600b-4fd4-9fd5-1dd4400dfaff None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.561197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f512f27-600b-4fd4-9fd5-1dd4400dfaff None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.561680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f512f27-600b-4fd4-9fd5-1dd4400dfaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.592546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f512f27-600b-4fd4-9fd5-1dd4400dfaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.594635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f512f27-600b-4fd4-9fd5-1dd4400dfaff None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-3f512f27-600b-4fd4-9fd5-1dd4400dfaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:26.627617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:26.629426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:26.630548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:26.630548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:26.630548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:26.630548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 360/742] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 620 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:26.633871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c5dc-a24a-42ba-85d4-b86badf80edd None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.634354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c5dc-a24a-42ba-85d4-b86badf80edd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.634836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c5dc-a24a-42ba-85d4-b86badf80edd None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.644167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 361/743] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:26.645548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c5dc-a24a-42ba-85d4-b86badf80edd None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.822377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fc059-c655-42ed-90b3-0c285e698b67 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.888804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c5dc-a24a-42ba-85d4-b86badf80edd None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.891953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.906830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.907904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.908398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.909080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.932681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.936516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:26.965554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:26.967334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:26.968610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:26.968610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:26.968610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:26.968610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 383/744] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:26.969756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.979902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e3ca2-3bca-467b-a71e-1b9e83fa4392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.980952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e3ca2-3bca-467b-a71e-1b9e83fa4392 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.981402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e3ca2-3bca-467b-a71e-1b9e83fa4392 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.981826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e3ca2-3bca-467b-a71e-1b9e83fa4392 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.997725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e3ca2-3bca-467b-a71e-1b9e83fa4392 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.999338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e3ca2-3bca-467b-a71e-1b9e83fa4392 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-5a9e3ca2-3bca-467b-a71e-1b9e83fa4392 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:27.018561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:27.020124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 362/745] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101519e-4e20-4a36-a0cc-018931b82059 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.023392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101519e-4e20-4a36-a0cc-018931b82059 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.024813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101519e-4e20-4a36-a0cc-018931b82059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.032013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:27.048773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8101519e-4e20-4a36-a0cc-018931b82059 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:27.050320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8101519e-4e20-4a36-a0cc-018931b82059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:27.150905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 363/746] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:27.152948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101519e-4e20-4a36-a0cc-018931b82059 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.219577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1729e-7816-41b7-afa6-5c73a09489a4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:27.299326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:27.300316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.300844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.301328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.302544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:27.303670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:27.307344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.345341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 384/747] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:27.350340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.414365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101519e-4e20-4a36-a0cc-018931b82059 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:27.448991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:27.481010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:27.488787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:27.490087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.490784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.491516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.492919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:27.493563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:27.495356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.514680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 364/748] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:27.516243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.583601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245501b-da54-40c0-aa2d-b8513570ae73 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:27.684847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:27.686919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.688595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.689456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.691788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:27.692799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:27.697940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.731010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca30f-9e48-4996-9867-b135dc4cd33c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:27.744812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 385/749] 10.222.0.71 () {56 vars in 1149 bytes} [Fri Sep 2 21:01:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:27.747172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.813136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:27.814343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.814858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.815358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] PATH_INFO: `/v3/users/nova` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.831291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:27.834322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:27.862161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:27.864409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:27.869066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:27.873153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 365/750] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:01:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:27.874836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.995857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.001335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dca3d3-d4b7-4ac2-a94e-ca39d1bc1dc7 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.003676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.090931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.092180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.092679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.093218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.110949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:28.113981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:28.119256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdabc9-ff96-4016-a009-4b2fd624300d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:28.145326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:28.147573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:28.149272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 386/751] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:28.152111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.188314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.189348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.189945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.190277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.192569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:28.194419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:28.304140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 366/752] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:01:27 2022] POST /identity/v3/services => generated 240 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:28.305599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.376982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c74100-4cbd-4007-b64b-e2477a05ab6e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.462088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.462861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.463150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.463434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.518293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.544941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef2291-b3d7-4bfa-98c1-5662289fff27 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.578929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.606994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.613570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.613570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.613570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.613570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:28.613570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:28.614224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:28.614358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:28.614484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:28.650658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 367/753] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:28.653672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.826474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 387/754] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:01:28.828077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.848845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e947e5-d85e-48fd-82e6-8ab765005d16 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.922223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.923405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.923894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.924365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.925723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:28.926260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:28.928921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.931443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:28.956349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 368/755] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:28.958310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.019345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f8183-dd86-4762-a55e-690d0ef6c039 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.026365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.090103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.091279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.091772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.092792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.114392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.117455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:29.149099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:29.150868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:29.152607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:29.152607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:29.152607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:29.152607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 388/756] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:29.152607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.200532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5ac11-a3f6-44c2-9f98-5fa23673d870 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.279642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ae6ae-4ace-4b5a-b249-82226df7e3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.280348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ae6ae-4ace-4b5a-b249-82226df7e3e5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.280630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ae6ae-4ace-4b5a-b249-82226df7e3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.281070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ae6ae-4ace-4b5a-b249-82226df7e3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.297594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ae6ae-4ace-4b5a-b249-82226df7e3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.299149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ae6ae-4ace-4b5a-b249-82226df7e3e5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-f76ae6ae-4ace-4b5a-b249-82226df7e3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:29.326503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:29.327756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:29.330135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:29.330135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:29.330135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:29.330135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 369/757] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:29.330583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcbb0-b7fa-499f-a1d0-d06cff833688 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.330782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcbb0-b7fa-499f-a1d0-d06cff833688 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.331416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcbb0-b7fa-499f-a1d0-d06cff833688 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.333471 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 370/758] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:29.339486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfcbb0-b7fa-499f-a1d0-d06cff833688 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.385068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac48f-9d39-46bb-84c9-72d571a586ee None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.404095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.452969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.453636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.453926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.454202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.455072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=27594eb14cf742ce8bcf21cdb8db5ef6) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:29.455646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.458676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.468571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 389/759] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/role_assignments?user.id=27594eb14cf742ce8bcf21cdb8db5ef6&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:29.470126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.523291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.558395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfcbb0-b7fa-499f-a1d0-d06cff833688 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.643389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811958-e6b2-4f2d-b29b-63656ee86861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.644658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811958-e6b2-4f2d-b29b-63656ee86861 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.646677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811958-e6b2-4f2d-b29b-63656ee86861 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.648491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811958-e6b2-4f2d-b29b-63656ee86861 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.649810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba811958-e6b2-4f2d-b29b-63656ee86861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:29.650363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba811958-e6b2-4f2d-b29b-63656ee86861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.653368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba811958-e6b2-4f2d-b29b-63656ee86861 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.686172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 371/760] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:29.688647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ad29-4d45-411d-9a2b-1f23bda230bb None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.689196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ad29-4d45-411d-9a2b-1f23bda230bb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.689698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ad29-4d45-411d-9a2b-1f23bda230bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.720200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be62e70-a1bd-4681-86b9-da1ddf588ec8 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.740882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0a07ad29-4d45-411d-9a2b-1f23bda230bb None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:29.740882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0a07ad29-4d45-411d-9a2b-1f23bda230bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:29.813798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.814783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.815174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.815598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.816822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:29.817359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.820977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.856535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 390/761] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:29.856535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.919375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.921201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 372/762] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:29.922898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07ad29-4d45-411d-9a2b-1f23bda230bb None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.055858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73db0-0d8a-435c-a45f-e7c8c8770dbd None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.129463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.130692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.131924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.132897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.150656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.155556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.158712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:30.182103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:30.183843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:30.185601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:30.189993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 391/763] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:30.201199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.273298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07ad29-4d45-411d-9a2b-1f23bda230bb None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.379869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.392872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f723d8-0e61-4fdf-b93a-0c445e43d62f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.403100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.404165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.404634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.405134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.426475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.430428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.454968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.456400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.457167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.458114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.459420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:30.460052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.462543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:30.481173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:30.482776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:30.483703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:30.487355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 392/764] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:30.492920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 373/765] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 566 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:30.495190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.497732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.685209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c2754-474f-4935-aaeb-8cd037583bd9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.721025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37dc1-530c-4d5e-bc7a-29b439971ca3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.761957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.763522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.764372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.765207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.766843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:30.779264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.782831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.797904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.816539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.816539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.816539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.816539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a55753c439f54804814aca0a3feb96ed/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.817411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=a55753c439f54804814aca0a3feb96ed, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.818181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 393/766] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:30.819502 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.821004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.857162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.956573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 374/767] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:30 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a55753c439f54804814aca0a3feb96ed/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:01:30.958368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:31.065708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65ca7-61a3-452e-8fac-84193094111d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:31.158894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:31.162276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.163775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.167409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.169036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:31.174874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:31.203436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:31.205373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:31.207040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:31.211612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 394/768] 10.222.0.71 () {56 vars in 1129 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:31.218322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:31.317310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f566f8-d2e2-4607-9766-6b43478578fd None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:31.409959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:31.411579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.413298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.413606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.414552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=4e11476429d84a6ba6ed2b9b71d28507) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:31.414861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:31.417329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:31.425569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:31.437301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 375/769] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/role_assignments?user.id=4e11476429d84a6ba6ed2b9b71d28507&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 259 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:31.479350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bf1d5-746f-49f5-8c03-76f217e61af9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:31.555624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:31.556581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.557033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.557443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.558576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:31.559027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:31.561379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:31.570552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 395/770] 10.222.0.71 () {56 vars in 1124 bytes} [Fri Sep 2 21:01:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:31.583157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:31.753428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:31.878052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940552e-8dcb-440d-bb8f-4703d54ada25 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:31.949134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0346ca-7c5a-4c9d-a8dc-c6c767745ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:31.949782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0346ca-7c5a-4c9d-a8dc-c6c767745ad0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.950058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0346ca-7c5a-4c9d-a8dc-c6c767745ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.950330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0346ca-7c5a-4c9d-a8dc-c6c767745ad0 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.950984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0346ca-7c5a-4c9d-a8dc-c6c767745ad0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:31.951369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0346ca-7c5a-4c9d-a8dc-c6c767745ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:31.952826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0346ca-7c5a-4c9d-a8dc-c6c767745ad0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:31.963674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 376/771] 10.222.0.71 () {56 vars in 1124 bytes} [Fri Sep 2 21:01:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:31.972898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:31.981358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302383d-7afc-43b0-9d6c-ed8cfc12cc1b None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.981814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302383d-7afc-43b0-9d6c-ed8cfc12cc1b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.982235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302383d-7afc-43b0-9d6c-ed8cfc12cc1b None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.985107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 377/772] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:31.993171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc579d-c478-4df8-8646-8062614cb0d7 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.993744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc579d-c478-4df8-8646-8062614cb0d7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.994118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc579d-c478-4df8-8646-8062614cb0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.017932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9cfc579d-c478-4df8-8646-8062614cb0d7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:32.019263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9cfc579d-c478-4df8-8646-8062614cb0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:32.127385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 378/773] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:01:32.220290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138aa8-84ce-4dfa-835e-d591475b8320 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.268153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.268807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.269100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.269373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.270196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] RBAC: Adding query filter params (interface=public, service_id=43f8941da87348d09499c498c187493e, region_id=RegionOne) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:32.270567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:32.272794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:32.282263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 396/774] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:01:31 2022] GET /identity/v3/endpoints?service_id=43f8941da87348d09499c498c187493e&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:32.290556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc579d-c478-4df8-8646-8062614cb0d7 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.400171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:32.484722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc579d-c478-4df8-8646-8062614cb0d7 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.520841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.533151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:32.545251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.546035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.546314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.560845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.560845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:32.560845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:32.565880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 379/775] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/services => generated 772 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:32.743258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b8f13-a7a1-4027-8ecc-34220b01eef9 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.823135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.824769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.825238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.825711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] PATH_INFO: `/v3/services/network` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.826789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:32.829392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:32.856114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:32.858054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:32.859664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 397/776] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/services/network => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:32.866376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.098015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8a5b-c333-4d99-be15-e7c238e1e17c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.127548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.185537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966e00-b582-4d3b-b26b-2758d01c77df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.187168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966e00-b582-4d3b-b26b-2758d01c77df None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.187939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966e00-b582-4d3b-b26b-2758d01c77df None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.188707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966e00-b582-4d3b-b26b-2758d01c77df None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.190313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966e00-b582-4d3b-b26b-2758d01c77df None admin] RBAC: Adding query filter params (name=network) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:33.191178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966e00-b582-4d3b-b26b-2758d01c77df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:33.195546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966e00-b582-4d3b-b26b-2758d01c77df None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:33.218071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 380/777] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:33.228370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.389588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.393595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850e99c-b848-4eed-bd03-b39b51192885 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.394526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850e99c-b848-4eed-bd03-b39b51192885 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.395328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850e99c-b848-4eed-bd03-b39b51192885 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.406982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 381/778] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:33 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:33.414195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cb712-b3f9-4d59-be2c-124800e15a23 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.414988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cb712-b3f9-4d59-be2c-124800e15a23 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.415664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cb712-b3f9-4d59-be2c-124800e15a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.451219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313488c1-5460-4d89-b59f-c283e923d0b6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.490758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ab2cb712-b3f9-4d59-be2c-124800e15a23 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:33.492916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ab2cb712-b3f9-4d59-be2c-124800e15a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:33.519850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.520712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.521143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.523147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.523147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] RBAC: Adding query filter params (type=network) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:33.523617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:33.525734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:33.535218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 398/779] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:33.550975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.765433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 382/780] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:01:33.843005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2d730-66d1-4d51-b69f-1ccfe70ef8ae None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.932661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.941402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.949913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.949913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.949913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.949913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] RBAC: Adding query filter params (interface=public, service_id=0f3fe339c5b641849e7edc606fec4a24, region_id=RegionOne) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:33.949913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:33.949913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:33.959375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 399/781] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/endpoints?service_id=0f3fe339c5b641849e7edc606fec4a24&interface=public®ion_id=RegionOne => generated 194 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:33.967528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cb712-b3f9-4d59-be2c-124800e15a23 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.200628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cb712-b3f9-4d59-be2c-124800e15a23 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.224415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:34.265671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23caa5-7476-4f36-a3e9-610c6249796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.267144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23caa5-7476-4f36-a3e9-610c6249796a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.267884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23caa5-7476-4f36-a3e9-610c6249796a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.268623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23caa5-7476-4f36-a3e9-610c6249796a None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.270199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23caa5-7476-4f36-a3e9-610c6249796a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:34.277096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23caa5-7476-4f36-a3e9-610c6249796a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:34.295490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 383/782] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/services => generated 772 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:34.478967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.712672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f24aaf-8657-4a5a-970c-4363edfeb597 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.713311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f24aaf-8657-4a5a-970c-4363edfeb597 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.713882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f24aaf-8657-4a5a-970c-4363edfeb597 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.723537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 384/783] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:34.727123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93cd87-7526-4262-83a2-1a6e25ed377a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.727123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93cd87-7526-4262-83a2-1a6e25ed377a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.727547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93cd87-7526-4262-83a2-1a6e25ed377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.756898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be65e05-5cbf-44ea-8cdc-11062b38a6c1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.773505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-db93cd87-7526-4262-83a2-1a6e25ed377a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:34.775529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-db93cd87-7526-4262-83a2-1a6e25ed377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:34.852203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28562-910c-4707-85ec-201f12322888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.853108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28562-910c-4707-85ec-201f12322888 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.853328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28562-910c-4707-85ec-201f12322888 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.853608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28562-910c-4707-85ec-201f12322888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.869095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c28562-910c-4707-85ec-201f12322888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:34.926081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 385/784] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-18c28562-910c-4707-85ec-201f12322888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:35.010952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:35.012759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:35.015005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 400/785] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 534 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:35.023054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93cd87-7526-4262-83a2-1a6e25ed377a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.284461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93cd87-7526-4262-83a2-1a6e25ed377a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.304779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:35.338183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28562-910c-4707-85ec-201f12322888 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.366416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.367328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.367790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.368245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.369360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:35.370119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:35.372849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:35.401881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 386/786] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:35.408684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.489155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:35.604974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28562-910c-4707-85ec-201f12322888 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.627166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0311d-2a53-4bd2-90b0-53be845fcbee None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.683445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55e2a3-5b2d-4ba2-8123-aeeee709fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.684086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e2a3-5b2d-4ba2-8123-aeeee709fb21 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.684374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e2a3-5b2d-4ba2-8123-aeeee709fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.684667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55e2a3-5b2d-4ba2-8123-aeeee709fb21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.689043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d51a2-6550-41c0-907a-5ef4a817f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.690628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d51a2-6550-41c0-907a-5ef4a817f0cb None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.691410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d51a2-6550-41c0-907a-5ef4a817f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.692176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d51a2-6550-41c0-907a-5ef4a817f0cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.701919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55e2a3-5b2d-4ba2-8123-aeeee709fb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:35.704220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55e2a3-5b2d-4ba2-8123-aeeee709fb21 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-de55e2a3-5b2d-4ba2-8123-aeeee709fb21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:35.729484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:35.731470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:35.733366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:35.733366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:35.733366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:35.733366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 387/787] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:35.733366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c3cb0-baee-43cf-95b1-cd03a865b4f3 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.733366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c3cb0-baee-43cf-95b1-cd03a865b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.733366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c3cb0-baee-43cf-95b1-cd03a865b4f3 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.739690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 388/788] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:35.741853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c3cb0-baee-43cf-95b1-cd03a865b4f3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.747086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d51a2-6550-41c0-907a-5ef4a817f0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-4b6d51a2-6550-41c0-907a-5ef4a817f0cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:35.758656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:35.761387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:35.763750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:35.767069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:35.778728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 401/789] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:35.781666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee230b0-fdf7-44ef-9bd8-40b30ea9b883 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.782497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee230b0-fdf7-44ef-9bd8-40b30ea9b883 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.783472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee230b0-fdf7-44ef-9bd8-40b30ea9b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.817508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-fee230b0-fdf7-44ef-9bd8-40b30ea9b883 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:35.820900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-fee230b0-fdf7-44ef-9bd8-40b30ea9b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:35.919607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c3cb0-baee-43cf-95b1-cd03a865b4f3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.968944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 402/790] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:35.970416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee230b0-fdf7-44ef-9bd8-40b30ea9b883 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.024392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.025838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.026329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.027012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.028367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:36.028945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.034745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.066594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 389/791] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:36.071239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.112847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.213494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee230b0-fdf7-44ef-9bd8-40b30ea9b883 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.265546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.266183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.266469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.266741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.267445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:36.267754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.269341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.283033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 403/792] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:36.290577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.437442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9977d7-d2d9-4005-9aad-860755425b0e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.461174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.462105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.502146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134490-eac3-467d-b38b-cc92dcda507a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.522829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecacc1-0810-4f42-922f-4ce64c2109b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.523499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecacc1-0810-4f42-922f-4ce64c2109b0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.523781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecacc1-0810-4f42-922f-4ce64c2109b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.524164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecacc1-0810-4f42-922f-4ce64c2109b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.555887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecacc1-0810-4f42-922f-4ce64c2109b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.559284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecacc1-0810-4f42-922f-4ce64c2109b0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.566910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6208ee7-8808-4e39-9057-b42f307ed535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.567930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6208ee7-8808-4e39-9057-b42f307ed535 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.568427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6208ee7-8808-4e39-9057-b42f307ed535 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.568928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6208ee7-8808-4e39-9057-b42f307ed535 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.587133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6208ee7-8808-4e39-9057-b42f307ed535 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-11ecacc1-0810-4f42-922f-4ce64c2109b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:36.587551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:36.589039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:36.590796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:36.590796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:36.590796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:36.590796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 404/793] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:36.591246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6208ee7-8808-4e39-9057-b42f307ed535 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.596817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d020448-67bf-45bb-85f5-dddbebba5c8c None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.596817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d020448-67bf-45bb-85f5-dddbebba5c8c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.596817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d020448-67bf-45bb-85f5-dddbebba5c8c None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.601244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 405/794] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:36.602895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d020448-67bf-45bb-85f5-dddbebba5c8c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e6208ee7-8808-4e39-9057-b42f307ed535 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:36.644904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:36.647326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:36.649650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 390/795] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 577 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:36.650638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198516-74b2-4b32-b5c6-ea88d9ae5451 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.656759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198516-74b2-4b32-b5c6-ea88d9ae5451 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.656759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198516-74b2-4b32-b5c6-ea88d9ae5451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.685194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-06198516-74b2-4b32-b5c6-ea88d9ae5451 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:36.687238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-06198516-74b2-4b32-b5c6-ea88d9ae5451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:36.804029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d020448-67bf-45bb-85f5-dddbebba5c8c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.832766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 391/796] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:36.832766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06198516-74b2-4b32-b5c6-ea88d9ae5451 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.870150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.871327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.871733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.872101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.873097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:36.873580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.876072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.902730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 406/797] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:36.904184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.954384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.985882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.053557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06198516-74b2-4b32-b5c6-ea88d9ae5451 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.099039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd21e6-e15b-48b4-8345-779c900f6b4a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.142859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.144460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.145287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.146105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.148242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:37.148665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.150234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.158994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.160716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.161785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.168920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.187413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:37.188348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 392/798] 10.222.0.71 () {56 vars in 1135 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:37.192937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:37.195592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:37.196582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:37.197824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:37.201321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 407/799] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:37.202962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.324508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.336042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f70d38-1a0e-4f42-9fd6-fd3ef74c247f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.353804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564292a-c061-428f-bc94-5d309016b659 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.367028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.390265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.391237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.391691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.392081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.406333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.408980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.412917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.413724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.414180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.414479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.415182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.417198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:37.430279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:37.431715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 393/800] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:37.433732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:37.434588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:37.435769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:37.437034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 408/801] 10.222.0.71 () {56 vars in 1129 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:37.437858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.602377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c649d-0829-478f-bcaf-7f5b6d2c6f1c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.623373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3417595-5225-4ead-86f1-da0cf1c3f0e9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.654886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341954ef-dfa5-4ca9-aa39-c522f1d60301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.655800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341954ef-dfa5-4ca9-aa39-c522f1d60301 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.656181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341954ef-dfa5-4ca9-aa39-c522f1d60301 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.656768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341954ef-dfa5-4ca9-aa39-c522f1d60301 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.657576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341954ef-dfa5-4ca9-aa39-c522f1d60301 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:37.657977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341954ef-dfa5-4ca9-aa39-c522f1d60301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.659788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341954ef-dfa5-4ca9-aa39-c522f1d60301 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.675128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 409/802] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:37.677216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15e1b-e183-409f-83b2-40a573433dca None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.678143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15e1b-e183-409f-83b2-40a573433dca None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.678616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15e1b-e183-409f-83b2-40a573433dca None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.682458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 410/803] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:37.682692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f15e1b-e183-409f-83b2-40a573433dca None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.697849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.698745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.699281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.699580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.699972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.715240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.716777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:37.738658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:37.740479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:37.741897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:37.741897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:37.741897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:37.744990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 394/804] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:37.747044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.804618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.862092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f15e1b-e183-409f-83b2-40a573433dca None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.901842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f579f-4cb6-4ab3-8a7d-2eca3336fe1f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.922667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.923285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.923559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.923825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.924599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:37.925047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.927058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.953929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 411/805] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:37.954930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.962374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa2f4a-51bc-4aa1-b8bf-a965931f8339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.962997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa2f4a-51bc-4aa1-b8bf-a965931f8339 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.963282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa2f4a-51bc-4aa1-b8bf-a965931f8339 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.963567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa2f4a-51bc-4aa1-b8bf-a965931f8339 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.964161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa2f4a-51bc-4aa1-b8bf-a965931f8339 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:37.965160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa2f4a-51bc-4aa1-b8bf-a965931f8339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.966610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa2f4a-51bc-4aa1-b8bf-a965931f8339 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.972410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 395/806] 10.222.0.71 () {56 vars in 1124 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:37.973728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e95710-222b-4026-ad29-1d0a31c9f456 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.974008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e95710-222b-4026-ad29-1d0a31c9f456 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.974271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e95710-222b-4026-ad29-1d0a31c9f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.995494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-02e95710-222b-4026-ad29-1d0a31c9f456 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:37.996922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-02e95710-222b-4026-ad29-1d0a31c9f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:38.044055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.101551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f2896-94ad-4f89-8d99-eb5f539e5c08 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.104674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 396/807] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:38.105608 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e95710-222b-4026-ad29-1d0a31c9f456 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.172526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.177304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.178642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.179238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.179863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.203526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.206483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:38.237293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:38.239521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:38.242539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:38.242539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:38.242539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:38.244389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 412/808] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:38.246289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.329223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e95710-222b-4026-ad29-1d0a31c9f456 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.405655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.406841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.407339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.407829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.409082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:38.409776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.412604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.448503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 397/809] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:38.448503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.468045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4105a-cc4c-45f7-9192-17597756b46f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.491677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.517342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.517968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.518248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.518519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.581619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.600252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca11096-e6be-4ecd-a1cc-c2322e928447 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.633549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.635190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.667478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.668467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.668895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.669348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.670547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:38.671080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.673599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.683467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 398/810] 10.222.0.71 () {56 vars in 1124 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:38.684591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.806354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 413/811] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:01:38.807866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.842785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.858978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbb5ed-9a99-43c6-93eb-eb874ff5afb3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.903723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.904460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.904764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.905041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.905701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:38.906004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.907422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.922322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 399/812] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:38.923195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.944656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.958723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007f1ca-91bf-4ecf-9187-b11a5ff13f64 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.010441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.011004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.011281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.011551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.019236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.020771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:39.040315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:39.042238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:39.043458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 414/813] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:39.044896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.102292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee4b7-5e33-4756-b8db-d344ebf46876 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.159408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.160720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.160720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.160720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.161250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.163119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.165412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:39.175460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:39.180369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:39.181251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 400/814] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:39.182056 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.204180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4fc6b-cbd7-46bd-bba7-135c0adf844b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.250124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.250738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.251015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.251282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.252114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.253671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.311439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:39.340561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293a013-2d16-4415-8f7f-390031b790e7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.388016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 415/815] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:01:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:39.388016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.398405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.399120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.399906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.399906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.416037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.418176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:39.442359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:39.444900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:39.446752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:39.446752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:39.446752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:39.446752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 401/816] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:39.446752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.597413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d09ca-8ecc-4dbd-a301-e8c8e5b6b028 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.658332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:39.668578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.669279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.675254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.675254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.675505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b5db-b329-47bc-82be-e032e1682c2f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.683076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.686043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:39.714275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:39.715396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:39.717518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 416/817] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:39.718721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.734512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:39.752977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.754152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.754982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.755489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.758562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:39.759111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.762305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.791152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 402/818] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:39.792297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.888672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63953e59-7b8c-418a-a576-16e798b4dc63 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.936775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.938402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.938402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.938708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.939725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] RBAC: Adding query filter params (name=network) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:39.940234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.943650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.961245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 417/819] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:39.961245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.962498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c724-15c9-4630-a282-43d53b06370e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.024551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.025275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.025559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.025837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.026638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:40.026979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.028894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.045468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 403/820] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:40.046338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.074287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.116491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.139087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def9744-2e1b-4c44-9fd1-78e892d4e763 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.184557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.185224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.185504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.185787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.186548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:40.186852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.188362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.195445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20559fcd-74ff-4751-b528-7e78831786a5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.210344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 418/821] 10.222.0.71 () {56 vars in 1149 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:40.211376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.248869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.250855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.251297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.251885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/27594eb14cf742ce8bcf21cdb8db5ef6/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.255103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=27594eb14cf742ce8bcf21cdb8db5ef6, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.257903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.375171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 404/822] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:40 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/27594eb14cf742ce8bcf21cdb8db5ef6/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:40.377173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.392578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb6f7-4451-49c0-a149-1ec59cf43071 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.424330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.466764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.467913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.468538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.469236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.470924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:40.470924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.477263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.489401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 419/823] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:40.489401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.551763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ba5c7-fe04-4395-ac33-287300021586 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.563154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.612700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.613442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.613726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.614004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.625932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.628263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:40.644756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:40.645781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:40.647599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:40.648132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 405/824] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:40.650210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.672463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a62a2-8d42-4e0d-8c70-b6bafc7ab8f2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.734672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.735676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.736026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.736343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.754097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.755964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:40.777003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:40.779094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:40.780339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:40.780339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:40.780339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:40.780339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 420/825] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:40.780339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.801614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6a0e1-8e8b-4d9b-a4bc-750f30787bd7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.829193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.861091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.862202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.862749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.863484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.864924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.866889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.955293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f835f03-c976-430e-bab2-11e8275172be None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.995418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 406/826] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:01:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:41.000675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.041205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.043486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.044342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.044920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.046596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:41.047551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.049894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.073807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 421/827] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.081911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.089373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.272838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6ae9d-047f-413d-928f-830450ef2f50 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.277368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.294318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8f9a0-3acc-4353-b7d8-6ab25a042f69 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.338795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.339770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.340274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.340560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.342023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a55753c439f54804814aca0a3feb96ed) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:41.342647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.345378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.348889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.350737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.351309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.352124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.353077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:41.353509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.357024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.357625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 422/828] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/role_assignments?user.id=a55753c439f54804814aca0a3feb96ed&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.373276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 407/829] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.382519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.529531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c597-b799-45ea-b438-cb1acbaa2323 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.595586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.596241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.596524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.596837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.606217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.607788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:41.622149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:41.624114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:41.627068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 423/830] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:41.633666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.805311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.834312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1538a-d312-4ac2-b032-2a3498fbd7ea None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.902216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9752a-ef32-4153-9b74-1e68217e6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.903292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9752a-ef32-4153-9b74-1e68217e6438 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.903784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9752a-ef32-4153-9b74-1e68217e6438 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.904265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9752a-ef32-4153-9b74-1e68217e6438 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.905612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9752a-ef32-4153-9b74-1e68217e6438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:41.906153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9752a-ef32-4153-9b74-1e68217e6438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.908985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9752a-ef32-4153-9b74-1e68217e6438 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.935449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 408/831] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.941968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.962588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:42.079246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151112-60d8-4384-b243-dfed892b65d4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:42.129211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870174c1-fd43-4399-a2c1-6fda784f1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:42.131387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870174c1-fd43-4399-a2c1-6fda784f1343 None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.132166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870174c1-fd43-4399-a2c1-6fda784f1343 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.132660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870174c1-fd43-4399-a2c1-6fda784f1343 None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/4e11476429d84a6ba6ed2b9b71d28507/roles/a71fb39654574349b08964577c193469` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.152392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870174c1-fd43-4399-a2c1-6fda784f1343 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=4e11476429d84a6ba6ed2b9b71d28507, role_id=a71fb39654574349b08964577c193469)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:42.154555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870174c1-fd43-4399-a2c1-6fda784f1343 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:42.307605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 424/832] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:41 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/4e11476429d84a6ba6ed2b9b71d28507/roles/a71fb39654574349b08964577c193469 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:42.402266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf400-51b7-4c3b-a38d-c507c64bcb12 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.402788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf400-51b7-4c3b-a38d-c507c64bcb12 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.402788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf400-51b7-4c3b-a38d-c507c64bcb12 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.404838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 409/833] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:42.410842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca3b03-472e-4c33-ab06-42ddb54f4820 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.411224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca3b03-472e-4c33-ab06-42ddb54f4820 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.411561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca3b03-472e-4c33-ab06-42ddb54f4820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.435976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-08ca3b03-472e-4c33-ab06-42ddb54f4820 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:42.437244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-08ca3b03-472e-4c33-ab06-42ddb54f4820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:42.531653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:42.552385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 425/834] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:42.814402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001e548-3cf0-4457-91a0-42836a68e80b None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.815399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001e548-3cf0-4457-91a0-42836a68e80b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.816291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001e548-3cf0-4457-91a0-42836a68e80b None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.819845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 410/835] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:42.826608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012ddd8-8b78-490b-b774-36841afd786d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.827574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012ddd8-8b78-490b-b774-36841afd786d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.828334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012ddd8-8b78-490b-b774-36841afd786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.862396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-d012ddd8-8b78-490b-b774-36841afd786d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:42.865601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d012ddd8-8b78-490b-b774-36841afd786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:42.922088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001e548-3cf0-4457-91a0-42836a68e80b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:42.959033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 426/836] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:43.089397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001e548-3cf0-4457-91a0-42836a68e80b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:43.134185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:43.134837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.135116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.135386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.135976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:43.137448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:43.148973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:43.150042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:43.151110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 411/837] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:43.160286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012ddd8-8b78-490b-b774-36841afd786d None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:43.295594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:43.303366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012ddd8-8b78-490b-b774-36841afd786d None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:43.330638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:43.337196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:43.349415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:43.350323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.350825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.351255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.352252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:43.352772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:43.354351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:43.361194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 427/838] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:43.371539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:43.471164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1548-e77e-4337-93d4-2a3987d1fc88 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:43.503610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9374-d816-4c5f-aa4f-1b6d134b754d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:43.545414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:43.546360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.546857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.547338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.551405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:43.552559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.553246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.553749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.554662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:43.555174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:43.557095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:43.564092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 428/839] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:43.572694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:43.579347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:43.580507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:43.581610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:43.585318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 412/840] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:43.596318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:43.673399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:43.757766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027578f5-da30-4e03-bb36-ffea92d9530b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:43.828329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:43.829867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.830657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.831403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.833034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:43.834393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:43.837116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:43.854974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 429/841] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:43.861306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.017848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.096036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5f322-79d4-402a-82ad-ff060711eed9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.169216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84866d9-d369-4ef6-9890-a96a78afabfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.170282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84866d9-d369-4ef6-9890-a96a78afabfa None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.170772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84866d9-d369-4ef6-9890-a96a78afabfa None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.171257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84866d9-d369-4ef6-9890-a96a78afabfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.194020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84866d9-d369-4ef6-9890-a96a78afabfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.197289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84866d9-d369-4ef6-9890-a96a78afabfa None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e84866d9-d369-4ef6-9890-a96a78afabfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:44.228182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:44.230059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:44.231850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:44.231850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:44.231850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:44.231850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 413/842] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:44.236395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.266908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503354-6021-4bb3-ad8e-35d63da7d1b8 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.267163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503354-6021-4bb3-ad8e-35d63da7d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.267478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503354-6021-4bb3-ad8e-35d63da7d1b8 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.270349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 414/843] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:44.276137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff2a9-1571-4691-8bcc-862126dbe5ef None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.276416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff2a9-1571-4691-8bcc-862126dbe5ef None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.276766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff2a9-1571-4691-8bcc-862126dbe5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.305379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-275ff2a9-1571-4691-8bcc-862126dbe5ef None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:44.307717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-275ff2a9-1571-4691-8bcc-862126dbe5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:44.431815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 415/844] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:01:44.454527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b78bfc-a234-4b83-83f1-fa60a9cc6d9a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.480127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.530211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.531432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.532376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.532899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.534051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:44.534795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.537146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.558956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 430/845] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:44.568053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff2a9-1571-4691-8bcc-862126dbe5ef None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.667935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.747666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff2a9-1571-4691-8bcc-862126dbe5ef None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.800855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.801753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.802931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.803285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.805575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.821098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.824205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:44.843236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:44.844675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:01:44.846366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:44.850076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 416/846] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:44.854201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.979060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41735-4706-46d0-80f8-69a2f24270c0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.992176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:45.030317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:45.031143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.031429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.031708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.032950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:45.033343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:45.035034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:45.035629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a76f6-9993-46b7-9f93-e35a388f95fc None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:45.077025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 417/847] 10.222.0.71 () {56 vars in 1135 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:45.085291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:45.104847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:45.108561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.109015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.112552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.113838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:45.118777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:45.141423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:45.142421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:45.143430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:45.149556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 431/848] 10.222.0.71 () {56 vars in 1132 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:45.156593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:45.233915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:45.235036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584942e-3127-45bc-8bbe-ea9338bdb2bd None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:45.288365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4192d-e476-457b-960c-488c4ca2fc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:45.290192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4192d-e476-457b-960c-488c4ca2fc82 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.290963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4192d-e476-457b-960c-488c4ca2fc82 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.291790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4192d-e476-457b-960c-488c4ca2fc82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.343890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:45.388757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933af09-dc0d-4dae-895d-ef83d14f0b92 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:45.391731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4192d-e476-457b-960c-488c4ca2fc82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:45.393715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4192d-e476-457b-960c-488c4ca2fc82 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:45.463086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba2237-ddb4-45e2-9410-f4e6deb09078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:45.464120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2237-ddb4-45e2-9410-f4e6deb09078 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.464608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2237-ddb4-45e2-9410-f4e6deb09078 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.465086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2237-ddb4-45e2-9410-f4e6deb09078 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.465898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba2237-ddb4-45e2-9410-f4e6deb09078 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:45.466533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba2237-ddb4-45e2-9410-f4e6deb09078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:45.468519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba2237-ddb4-45e2-9410-f4e6deb09078 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:45.480823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 432/849] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:01:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:45.480823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebeaaf-d078-4e72-8c8a-3d2aafe12a9a None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.480823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebeaaf-d078-4e72-8c8a-3d2aafe12a9a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.480823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebeaaf-d078-4e72-8c8a-3d2aafe12a9a None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.482687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 433/850] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:45.486042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebeaaf-d078-4e72-8c8a-3d2aafe12a9a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:45.584640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 418/851] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:01:45.586908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9eed-1cd4-449b-98e4-ae456a3966c7 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.587192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9eed-1cd4-449b-98e4-ae456a3966c7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.587511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9eed-1cd4-449b-98e4-ae456a3966c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.612390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ab6c9eed-1cd4-449b-98e4-ae456a3966c7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:45.614310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ab6c9eed-1cd4-449b-98e4-ae456a3966c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:45.647494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:45.653275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebeaaf-d078-4e72-8c8a-3d2aafe12a9a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:45.706041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:45.707812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.709276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.710069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.711308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:45.711866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:45.714650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:45.717258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:45.737130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 434/852] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:01:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:45.737130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:45.746804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 419/853] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:45.965059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e007a9-16b9-4a36-87b8-901e94880885 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:46.043752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:46.044881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.045374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.045866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.067346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:46.070305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:46.106295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:46.107599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:46.109563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:46.109563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:46.109563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:46.113389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 435/854] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:46.122500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c9eed-1cd4-449b-98e4-ae456a3966c7 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:46.176872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:46.212820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:46.279894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c9eed-1cd4-449b-98e4-ae456a3966c7 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:46.340764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:46.341408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.341688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.341958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.342649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:46.343053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:46.345082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:46.364090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 420/855] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:46.376053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:46.398973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677fafe-e2ad-4b47-bd87-91bd765fa55a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:46.471696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:46.480370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:46.482268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.483098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.483557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.511663 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:46.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:46.529639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:46.531442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 436/856] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:01:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:46.542251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:46.554484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08a882-c36b-45f7-9842-be57deca25eb None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:46.615088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:46.616286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.616286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.616528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.627628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:46.630113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:46.646124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:46.647851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:46.650284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:46.653330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 421/857] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:46.655314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:46.764051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:46.831048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950f9c-afd9-4aeb-af3b-ee4d7c79c130 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:46.858080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865faf5-a3ae-42ca-9f30-1b1867ea283b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:46.886278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fe7e9-afea-4ddf-b4d3-2d4e888e9578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:46.887757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fe7e9-afea-4ddf-b4d3-2d4e888e9578 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.888810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fe7e9-afea-4ddf-b4d3-2d4e888e9578 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.889043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fe7e9-afea-4ddf-b4d3-2d4e888e9578 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.889997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fe7e9-afea-4ddf-b4d3-2d4e888e9578 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:46.890454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fe7e9-afea-4ddf-b4d3-2d4e888e9578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:46.893411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fe7e9-afea-4ddf-b4d3-2d4e888e9578 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:46.902677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:46.911413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 437/858] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:01:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:46.915581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085047-2d0a-41e7-a522-54f257262fb1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.916095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085047-2d0a-41e7-a522-54f257262fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.916585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085047-2d0a-41e7-a522-54f257262fb1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.919308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 438/859] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:46.922746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085047-2d0a-41e7-a522-54f257262fb1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:46.938126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032e2c5-bd40-4202-8d82-ef8464676a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:46.938987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e2c5-bd40-4202-8d82-ef8464676a48 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.939403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e2c5-bd40-4202-8d82-ef8464676a48 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.939843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e2c5-bd40-4202-8d82-ef8464676a48 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.941619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e2c5-bd40-4202-8d82-ef8464676a48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:46.941856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e2c5-bd40-4202-8d82-ef8464676a48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:46.944153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e2c5-bd40-4202-8d82-ef8464676a48 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:46.963579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 422/860] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:46.966445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c214-7b0a-4941-b079-32041033d5dd None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.967295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c214-7b0a-4941-b079-32041033d5dd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.968042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c214-7b0a-4941-b079-32041033d5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.994739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-74e8c214-7b0a-4941-b079-32041033d5dd None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:46.996626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-74e8c214-7b0a-4941-b079-32041033d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:47.115459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 423/861] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:47.117475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8c214-7b0a-4941-b079-32041033d5dd None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:47.150953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085047-2d0a-41e7-a522-54f257262fb1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.213194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.214966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.215731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.217158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.234929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:47.242388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:47.245128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:47.280601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:47.288626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:47.296115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:47.296115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:47.296115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:47.296115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 439/862] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:47.296115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:47.353892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8c214-7b0a-4941-b079-32041033d5dd None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.371218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:47.431066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41016701-0766-4659-a258-18cdee201db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.432160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41016701-0766-4659-a258-18cdee201db9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.432652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41016701-0766-4659-a258-18cdee201db9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.433204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41016701-0766-4659-a258-18cdee201db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.434727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41016701-0766-4659-a258-18cdee201db9 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=27594eb14cf742ce8bcf21cdb8db5ef6) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:47.435287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41016701-0766-4659-a258-18cdee201db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:47.438282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41016701-0766-4659-a258-18cdee201db9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:47.451960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 424/863] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:47 2022] GET /identity/v3/role_assignments?user.id=27594eb14cf742ce8bcf21cdb8db5ef6&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:47.511350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772556b8-c970-4a0f-b984-1269708390f4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.560988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41016701-0766-4659-a258-18cdee201db9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:47.574410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.575051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.575344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.575618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.576296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:47.576699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:47.578287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:47.596507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 440/864] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:47.606440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:47.694235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:47.791066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41016701-0766-4659-a258-18cdee201db9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.803283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072eac0-6023-4e31-b390-8e6d4c821408 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.860360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.861480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.861890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.862539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.863538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:47.866522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:47.881976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.892429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.892429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.892429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.908062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:47.908062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:47.933188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:47.934833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:47.936397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 441/865] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:01:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:47.946507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.013003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 425/866] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:01:47 2022] POST /identity/v3/services => generated 251 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:01:48.182344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd8b24-0058-4857-9e21-169a8b74bb1a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.201947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.265165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.265797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.266084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.266357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.267114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:48.267489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:48.269157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:48.303983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 442/867] 10.222.0.71 () {56 vars in 1149 bytes} [Fri Sep 2 21:01:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:48.310462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.355809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.494180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5203259-8bcf-4a5c-8555-5d34f4f7987e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.577637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cad537-7f26-43db-8214-1c819b46de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.579019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cad537-7f26-43db-8214-1c819b46de3a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.579733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cad537-7f26-43db-8214-1c819b46de3a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.580402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cad537-7f26-43db-8214-1c819b46de3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.727156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cad537-7f26-43db-8214-1c819b46de3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:48.730337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cad537-7f26-43db-8214-1c819b46de3a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:48.795130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.947051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 426/868] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:01:48.957520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.108383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93e324-89d9-415e-b1c2-1ee4eee03463 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.137148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a23b8-0c06-45e5-8743-d7b0bf8daead None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.137945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a23b8-0c06-45e5-8743-d7b0bf8daead None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.138444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a23b8-0c06-45e5-8743-d7b0bf8daead None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.145260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 427/869] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:49.151099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c404b05-ab38-4ec1-b80e-8e85f6907d07 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.151592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c404b05-ab38-4ec1-b80e-8e85f6907d07 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.152075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c404b05-ab38-4ec1-b80e-8e85f6907d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.160414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.161107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.161432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.161886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.175690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.177878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.185628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7c404b05-ab38-4ec1-b80e-8e85f6907d07 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:49.188013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7c404b05-ab38-4ec1-b80e-8e85f6907d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:49.198044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:49.199993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:49.203486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:49.203486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:49.203486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:49.203486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 443/870] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:49.210208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.262135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.314884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 428/871] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:49.443864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd218-bf73-4edf-9cee-c10023cb635a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.516429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.517506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.517994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.518487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.519698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:49.520213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.523571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.551931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 444/872] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:49.561866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c404b05-ab38-4ec1-b80e-8e85f6907d07 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.697903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.792306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c404b05-ab38-4ec1-b80e-8e85f6907d07 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.796153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.869099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.871279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.872074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.872837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.888106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.891939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:49.918527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:49.920371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:49.922135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:49.926572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 429/873] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:49.933901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.951178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.008272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759737b-8b55-4231-8797-3b5c86405353 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.055472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.056366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.056950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.057541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.058538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.060300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.107630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b969308-fe40-467a-983d-b52ab13e258b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.150807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.171829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 445/874] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:01:49 2022] POST /identity/v3/services => generated 269 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:50.190042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba562a47-e1ca-4628-bd32-ee7139e42631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.190804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba562a47-e1ca-4628-bd32-ee7139e42631 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.191087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba562a47-e1ca-4628-bd32-ee7139e42631 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.191364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba562a47-e1ca-4628-bd32-ee7139e42631 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.192119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba562a47-e1ca-4628-bd32-ee7139e42631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:50.192495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba562a47-e1ca-4628-bd32-ee7139e42631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.195177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba562a47-e1ca-4628-bd32-ee7139e42631 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.212293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 430/875] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.223761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.341457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d746bb-ee11-4b8f-b487-6cbe76645bee None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.341718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d746bb-ee11-4b8f-b487-6cbe76645bee None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.342011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d746bb-ee11-4b8f-b487-6cbe76645bee None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.344359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 431/876] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:50.353193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096acc-3978-4fbd-9e4c-293d1ce9e1d9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.353701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096acc-3978-4fbd-9e4c-293d1ce9e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.354308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096acc-3978-4fbd-9e4c-293d1ce9e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.390769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-57096acc-3978-4fbd-9e4c-293d1ce9e1d9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:50.394336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-57096acc-3978-4fbd-9e4c-293d1ce9e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:50.472954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a933d-6f6a-45a3-87c4-2d292092ca3a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.525892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.526586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.526872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.527146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.528290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=4e11476429d84a6ba6ed2b9b71d28507) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:50.528625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.530127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.532583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.539104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 446/877] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/role_assignments?user.id=4e11476429d84a6ba6ed2b9b71d28507&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.570714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 432/878] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:50.918951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.104578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d92c-4bdd-4988-b56b-daf73a7b727e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.165450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1849f-3087-45c2-9fa7-60dcd0ea0292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.166760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1849f-3087-45c2-9fa7-60dcd0ea0292 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.167369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1849f-3087-45c2-9fa7-60dcd0ea0292 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.167927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1849f-3087-45c2-9fa7-60dcd0ea0292 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.169033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1849f-3087-45c2-9fa7-60dcd0ea0292 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.171380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1849f-3087-45c2-9fa7-60dcd0ea0292 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-b9c1849f-3087-45c2-9fa7-60dcd0ea0292 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:51.187421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:51.189255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:01:51.190787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:51.194979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 447/879] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:51.201206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096acc-3978-4fbd-9e4c-293d1ce9e1d9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.218138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d863b7b-fd64-43b9-852d-a9e1954b9f07 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.218464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d863b7b-fd64-43b9-852d-a9e1954b9f07 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.218701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d863b7b-fd64-43b9-852d-a9e1954b9f07 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.221185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 448/880] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:51.227458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f23b37-dee7-48a3-b139-7eff1f251bbd None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.227806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f23b37-dee7-48a3-b139-7eff1f251bbd None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.228025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f23b37-dee7-48a3-b139-7eff1f251bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.251226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a7f23b37-dee7-48a3-b139-7eff1f251bbd None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:51.252474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a7f23b37-dee7-48a3-b139-7eff1f251bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:51.349200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:51.365443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 449/881] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:01:51.401794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096acc-3978-4fbd-9e4c-293d1ce9e1d9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.415273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:51.453044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.453968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.454452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.454878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.455703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:51.462315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.464220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.471445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 433/882] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:51.479414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f23b37-dee7-48a3-b139-7eff1f251bbd None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.685505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f23b37-dee7-48a3-b139-7eff1f251bbd None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.757967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.759043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.759501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.759906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.760903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:51.761339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.763541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.773809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 450/883] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:51.822258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.979385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2014e-e0f5-4d23-96a2-aa9a3463bee8 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.032762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.034123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.034623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.035101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.035911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:52.038491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:52.058750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:52.060457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:52.062028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:52.067145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 434/884] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:52.076629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.188820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:52.276294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3319b7f-b5f9-48ca-ba90-ed6fbbfbadcb None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.337036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.337960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.338366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.338781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.339771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:52.340216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:52.342697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:52.354505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 451/885] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:52.362235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.421128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:52.544849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd02b4-0f2d-4173-8ca1-e4de63303b7c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.594275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ac7c7-31ae-4e36-b99d-4ff177ffdba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.595256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ac7c7-31ae-4e36-b99d-4ff177ffdba3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.595768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ac7c7-31ae-4e36-b99d-4ff177ffdba3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.596425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ac7c7-31ae-4e36-b99d-4ff177ffdba3 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.597673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ac7c7-31ae-4e36-b99d-4ff177ffdba3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:52.598201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ac7c7-31ae-4e36-b99d-4ff177ffdba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:52.604344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ac7c7-31ae-4e36-b99d-4ff177ffdba3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:52.615069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 435/886] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:52.623986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.771473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ad8e-be4e-4ca7-8104-8c6eddfc8d02 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.771960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ad8e-be4e-4ca7-8104-8c6eddfc8d02 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.772690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ad8e-be4e-4ca7-8104-8c6eddfc8d02 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.781262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 436/887] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:52.784632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932a43d-39ed-4942-979d-2106b892885f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.785326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932a43d-39ed-4942-979d-2106b892885f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.786055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932a43d-39ed-4942-979d-2106b892885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.817039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d23c-0301-4c5d-9e78-a4f7d10caa5c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.821633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1932a43d-39ed-4942-979d-2106b892885f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:52.823746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1932a43d-39ed-4942-979d-2106b892885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:52.869368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:52.906184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.906894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.907177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.907449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.912942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] RBAC: Adding query filter params (interface=public, service_id=18b2447547ab4a108074eb22f97275bb, region_id=RegionOne) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:52.914963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:52.922149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:52.939139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 452/888] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/endpoints?service_id=18b2447547ab4a108074eb22f97275bb&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:52.945452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.978468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 437/889] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:53.155035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbdd00-0d89-4ef5-9a67-9d7c653f5310 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:53.229114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78e0a5-dee3-47e3-80e9-b19c41928636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:53.231626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e0a5-dee3-47e3-80e9-b19c41928636 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.232447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e0a5-dee3-47e3-80e9-b19c41928636 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.233233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e0a5-dee3-47e3-80e9-b19c41928636 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.234687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78e0a5-dee3-47e3-80e9-b19c41928636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:53.237625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78e0a5-dee3-47e3-80e9-b19c41928636 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:53.252062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 453/890] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/services => generated 1268 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:01:53.527733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932a43d-39ed-4942-979d-2106b892885f None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:53.578965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:53.720541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0fbd-02d8-499e-846f-6067a7526b68 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.721081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0fbd-02d8-499e-846f-6067a7526b68 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.724787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932a43d-39ed-4942-979d-2106b892885f None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:53.725054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0fbd-02d8-499e-846f-6067a7526b68 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.725947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 454/891] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:53.734830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544ccb3-9ecc-4c25-b3c4-7eeaf7e0bff7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.735356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544ccb3-9ecc-4c25-b3c4-7eeaf7e0bff7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.735835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544ccb3-9ecc-4c25-b3c4-7eeaf7e0bff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.780193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1544ccb3-9ecc-4c25-b3c4-7eeaf7e0bff7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:53.783148 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1544ccb3-9ecc-4c25-b3c4-7eeaf7e0bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:53.798580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:53.799447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.799721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.799992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.800607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:53.803774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:53.837640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:53.839434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:53.841222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 438/892] 10.222.0.71 () {56 vars in 1132 bytes} [Fri Sep 2 21:01:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:53.848557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:53.893930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:53.944053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 455/893] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:54.071419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:54.088657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3def4-de97-4884-bafa-a0586b4eb5d9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.162447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.163517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.164014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.164490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.165774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:54.166256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.169217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.179796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 439/894] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:01:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:54.187768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544ccb3-9ecc-4c25-b3c4-7eeaf7e0bff7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.385769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544ccb3-9ecc-4c25-b3c4-7eeaf7e0bff7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.463020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.464971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.465825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.466633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.468246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:54.468871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.469469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.471789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.483710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 456/895] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:54.494277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.578356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:54.670423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224bc1-70c5-4b41-807a-767bfe137ceb None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.700011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ad78-f964-49de-a0ab-6c80ed198726 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.747340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.748666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.749316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.749901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.772141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.772895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:54.773970 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.774697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.775396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.777038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] RBAC: Adding query filter params (interface=public, service_id=488764c034414e02885a95cd3f4abcc2, region_id=RegionOne) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:54.777694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.780427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:54.784176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:54.785432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:01:54.788305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:54.793767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 440/896] 10.222.0.71 () {56 vars in 1120 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:54.803683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.804514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 457/897] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/endpoints?service_id=488764c034414e02885a95cd3f4abcc2&interface=public®ion_id=RegionOne => generated 194 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:54.806975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.838983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:54.987919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff6d06-ba9b-4055-b7b9-e78ae196f1ae None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.001698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.016019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65f360-04e1-4203-bb1d-f41ac03fecd3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.047647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cea7f-a4b0-4639-b004-ea242bf229ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.048325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cea7f-a4b0-4639-b004-ea242bf229ff None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.048325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cea7f-a4b0-4639-b004-ea242bf229ff None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.049167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cea7f-a4b0-4639-b004-ea242bf229ff None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.049715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cea7f-a4b0-4639-b004-ea242bf229ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.051383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cea7f-a4b0-4639-b004-ea242bf229ff None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.064770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 458/898] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/services => generated 1268 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:01:55.064770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932994a-6965-4fbf-a936-41569f9644a1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.064770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932994a-6965-4fbf-a936-41569f9644a1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.064770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932994a-6965-4fbf-a936-41569f9644a1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.064770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 459/899] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:55.077454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496098e-0667-4609-9f9f-9b2260282ac8 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.078472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496098e-0667-4609-9f9f-9b2260282ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.079512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496098e-0667-4609-9f9f-9b2260282ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.101303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.102380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.102860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.103330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.104619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:55.105190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.108846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.124075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-8496098e-0667-4609-9f9f-9b2260282ac8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:55.126760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8496098e-0667-4609-9f9f-9b2260282ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:55.141284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 441/900] 10.222.0.71 () {56 vars in 1115 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:55.143154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.297310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 460/901] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:55.337383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.387207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4d29-94fe-41b1-a214-5a3982534e2a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.468615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.469881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.470392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.470892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.493621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.496513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:55.538124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:55.540022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:55.542407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:55.542407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:55.542407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:55.542407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 442/902] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:55.550120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496098e-0667-4609-9f9f-9b2260282ac8 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.753934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.760088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496098e-0667-4609-9f9f-9b2260282ac8 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.816880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.831642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.832662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.833942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.834308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.835382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:55.835915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.838650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.868326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 461/903] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:55.875987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.044606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb03f7-9a6e-45b8-a364-433a76b9eaba None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.123103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:56.136629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7178ad-5081-4720-8b41-886f392ff2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.138002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7178ad-5081-4720-8b41-886f392ff2dd None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.138196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466b4d-5a2f-4cbd-aa8d-c44fe7550e64 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.138764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7178ad-5081-4720-8b41-886f392ff2dd None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.150517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7178ad-5081-4720-8b41-886f392ff2dd None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.150517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7178ad-5081-4720-8b41-886f392ff2dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.150517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7178ad-5081-4720-8b41-886f392ff2dd None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.222830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.224474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.225019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.226258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.247316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.250206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:01:56.275675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:56.277922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:56.289935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 462/904] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:56.294733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.303283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 443/905] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:01:55 2022] POST /identity/v3/services => generated 241 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:01:56.346381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:56.530759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf160de-81e7-4db9-b3af-430837883d9b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.608372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6289-3de1-4eb1-a328-8a423ce5967d None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.608372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6289-3de1-4eb1-a328-8a423ce5967d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.608993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6289-3de1-4eb1-a328-8a423ce5967d None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.612385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 444/906] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:56.623978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348421-c531-4d0f-af2c-5966e52b2a36 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.626440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.629676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348421-c531-4d0f-af2c-5966e52b2a36 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.629676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348421-c531-4d0f-af2c-5966e52b2a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.629998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.629998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.629998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.629998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:56.629998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.632802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.666970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2f348421-c531-4d0f-af2c-5966e52b2a36 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:56.668385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2f348421-c531-4d0f-af2c-5966e52b2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:56.673445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 463/907] 10.222.0.71 () {56 vars in 1149 bytes} [Fri Sep 2 21:01:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:56.683155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.859564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 445/908] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:56.878685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:56.919379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6d47e-cb13-4f84-9d3e-5545ae275265 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.994869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.996336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.996768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.997457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.123643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:57.125143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:57.287116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.346318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 464/909] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:56 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:01:57.357012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f348421-c531-4d0f-af2c-5966e52b2a36 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.373117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.610388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ad79-ed83-42d3-b690-089af555693a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.639758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f348421-c531-4d0f-af2c-5966e52b2a36 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.680172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.681002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.681188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.681463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.682131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:57.683969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:57.685295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:57.701261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:57.718083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:57.719386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 465/910] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:57.720611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.720713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.720713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.720713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.720713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.734644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:57.737835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:01:57.780103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:57.781143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:01:57.782369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:01:57.782369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:01:57.782369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:57.785703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 446/911] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:57.795446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.843502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.012270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae13a79-5a5c-43af-a9b1-72f21316fd81 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.059033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a090d-c078-48bd-a059-78faff2bb433 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.088016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.089136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.089631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.090162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.091951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:58.092932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.096343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.111216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 466/912] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:58.122632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.159827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.161106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.163192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.163719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.165251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:58.165814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.168523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.204505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 447/913] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:58.208183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.268663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.333524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e6727-db5b-48cf-ae0d-d7e1317aea69 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.335841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.401595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.402233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.402518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.402793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.403993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:58.404479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.405940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.422098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 467/914] 10.222.0.71 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:58.422302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bde5f5-bd53-4fa4-b612-6d54b37024c2 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.425126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.498476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.499660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.500216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.500838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.515735 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.518200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:01:58.539406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:58.541759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:01:58.543826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 448/915] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:58.547344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.678417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df25e4-0548-49da-a915-8b27ead44214 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.746628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.750065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572d78f-4f9f-49e9-839e-1371252adb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.750894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d78f-4f9f-49e9-839e-1371252adb3d None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.751365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d78f-4f9f-49e9-839e-1371252adb3d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.751764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d78f-4f9f-49e9-839e-1371252adb3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.752462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572d78f-4f9f-49e9-839e-1371252adb3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.754038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572d78f-4f9f-49e9-839e-1371252adb3d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.767194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd8c7-9535-440f-aac8-73faf061abd0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.845543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814a829-6841-498c-9fc7-0a87272ec7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.845543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a829-6841-498c-9fc7-0a87272ec7b1 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.845543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a829-6841-498c-9fc7-0a87272ec7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.845543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a829-6841-498c-9fc7-0a87272ec7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.846463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814a829-6841-498c-9fc7-0a87272ec7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:58.846807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814a829-6841-498c-9fc7-0a87272ec7b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.849739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814a829-6841-498c-9fc7-0a87272ec7b1 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.869721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 449/916] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:58.875604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affcf0-0299-4d53-a8a9-956d0b5f83c7 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.875604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affcf0-0299-4d53-a8a9-956d0b5f83c7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.875604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56affcf0-0299-4d53-a8a9-956d0b5f83c7 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.877291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 450/917] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:58.878547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56affcf0-0299-4d53-a8a9-956d0b5f83c7 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.893768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 468/918] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:01:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:01:58.897090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9074-5dab-412b-8dd4-18c6e9fdd037 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.897996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9074-5dab-412b-8dd4-18c6e9fdd037 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.898859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9074-5dab-412b-8dd4-18c6e9fdd037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.938026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f93c9074-5dab-412b-8dd4-18c6e9fdd037 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:58.941167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f93c9074-5dab-412b-8dd4-18c6e9fdd037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:58.982588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:59.095209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56affcf0-0299-4d53-a8a9-956d0b5f83c7 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.101159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 469/919] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:59.166732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c754e-cbed-4cd3-8073-bff5d6a62415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.167786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c754e-cbed-4cd3-8073-bff5d6a62415 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.168302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c754e-cbed-4cd3-8073-bff5d6a62415 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.168851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c754e-cbed-4cd3-8073-bff5d6a62415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.170301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c754e-cbed-4cd3-8073-bff5d6a62415 None admin] RBAC: Adding query filter params (role.id=db6dd05456bf4ae7a5ff75fe009aea4f, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=4e11476429d84a6ba6ed2b9b71d28507) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:59.170883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c754e-cbed-4cd3-8073-bff5d6a62415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:59.174041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c754e-cbed-4cd3-8073-bff5d6a62415 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:59.186885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 451/920] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/role_assignments?user.id=4e11476429d84a6ba6ed2b9b71d28507&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=db6dd05456bf4ae7a5ff75fe009aea4f => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:59.386708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad758d2-faad-4162-afb8-7c13d278681e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.387085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad758d2-faad-4162-afb8-7c13d278681e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.387485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad758d2-faad-4162-afb8-7c13d278681e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.390454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 470/921] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:01:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:59.400127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b7644-9f51-4479-a381-c78d1545fe42 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.400596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b7644-9f51-4479-a381-c78d1545fe42 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.401136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b7644-9f51-4479-a381-c78d1545fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.437525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a30b7644-9f51-4479-a381-c78d1545fe42 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:59.439642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a30b7644-9f51-4479-a381-c78d1545fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:59.456873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:59.592390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 452/922] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:01:59.610855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad758d2-faad-4162-afb8-7c13d278681e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:59.825984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad758d2-faad-4162-afb8-7c13d278681e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.883850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.884901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.885421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.885930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.887082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:59.889381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:59.902044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:59.903037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:01:59.903991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 471/923] 10.222.0.71 () {56 vars in 1132 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:59.913406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b7644-9f51-4479-a381-c78d1545fe42 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.012244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.046139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.115765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b7644-9f51-4479-a381-c78d1545fe42 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.188252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.190033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.190517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.191005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.192272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:00.192836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.195734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.216531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e675a-8af3-4f92-955e-76c65377bf94 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.217287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 453/924] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:00.227153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.245690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.307412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.309472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.310286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.311975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.313926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.317416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:00.344350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:00.346855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:00.348599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:00.353917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 472/925] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:00.361940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.469605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba28e-7940-4399-b9f6-55ce212c1d4d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.529745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.538744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.540063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.540287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.540943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.546639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:00.546639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.546639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.560900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 454/926] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:00.570573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.612306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d4138-83bb-4958-80ff-05ec61d1e960 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.705700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.707128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.707292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.707599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.709356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:00.710258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.712801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.721313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.743909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 473/927] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:00.752209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.811639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd06b4a-faee-4a83-818d-5eca6d48fed0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.899258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.900310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.900850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.901351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.902637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.906152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.970919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b42df-1e71-4dd9-8ff1-69056d42526c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:01.045411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 455/928] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:01.065263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:01.066770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:01.068050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:01.068620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:01.069889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:01.070504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:01.073199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:01.077835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:01.086079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 474/929] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:01.098845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:01.358446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e81db2-ce27-4331-a180-0ecd292b61c1 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:01.427607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:01.448507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13ae22-a8f0-4409-a3b3-dcdb24b6e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:01.449621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13ae22-a8f0-4409-a3b3-dcdb24b6e3ba None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:01.450086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13ae22-a8f0-4409-a3b3-dcdb24b6e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:01.450651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13ae22-a8f0-4409-a3b3-dcdb24b6e3ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:01.452014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13ae22-a8f0-4409-a3b3-dcdb24b6e3ba None admin] RBAC: Adding query filter params (interface=public, service_id=1adc1d41e2cf4d4ca726078e04626045, region_id=RegionOne) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:01.452548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13ae22-a8f0-4409-a3b3-dcdb24b6e3ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:01.455279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13ae22-a8f0-4409-a3b3-dcdb24b6e3ba None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:01.471831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 456/930] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:01 2022] GET /identity/v3/endpoints?service_id=1adc1d41e2cf4d4ca726078e04626045&interface=public®ion_id=RegionOne => generated 194 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:01.480657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:01.739844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b87e-9048-4cd0-abc7-72e689b87a89 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:01.819614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c523d-0097-4d80-828a-d6c9f7758a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:01.820683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c523d-0097-4d80-828a-d6c9f7758a2a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:01.821236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c523d-0097-4d80-828a-d6c9f7758a2a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:01.821744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c523d-0097-4d80-828a-d6c9f7758a2a None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:01.823064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c523d-0097-4d80-828a-d6c9f7758a2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:01.825849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c523d-0097-4d80-828a-d6c9f7758a2a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:01.841095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 475/931] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:01 2022] GET /identity/v3/services => generated 1497 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:02:01.928033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1c24-7883-45c8-bb11-f779dac1705b None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:01.928495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1c24-7883-45c8-bb11-f779dac1705b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:01.928641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1c24-7883-45c8-bb11-f779dac1705b None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:01.930631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 457/932] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:01.938920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b21d6-b24e-4e4e-abde-c8b25328559b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:01.939438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b21d6-b24e-4e4e-abde-c8b25328559b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:01.939865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b21d6-b24e-4e4e-abde-c8b25328559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:01.976896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-002b21d6-b24e-4e4e-abde-c8b25328559b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:01.978223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-002b21d6-b24e-4e4e-abde-c8b25328559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:02.108500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:02.125089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 476/933] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:02.378114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1a52-cc27-462e-a04e-a2ef7be82b23 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:02.378925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1a52-cc27-462e-a04e-a2ef7be82b23 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:02.378925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1a52-cc27-462e-a04e-a2ef7be82b23 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:02.383223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 458/934] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:02.392378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ddeda-07ae-4b8c-aa90-c1acf4ecc804 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:02.392906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ddeda-07ae-4b8c-aa90-c1acf4ecc804 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:02.393400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ddeda-07ae-4b8c-aa90-c1acf4ecc804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:02.435228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-5d4ddeda-07ae-4b8c-aa90-c1acf4ecc804 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:02.436636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5d4ddeda-07ae-4b8c-aa90-c1acf4ecc804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:02.531500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1a52-cc27-462e-a04e-a2ef7be82b23 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:02.613232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 477/935] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:02.735246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1a52-cc27-462e-a04e-a2ef7be82b23 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:02.807289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:02.808346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:02.808648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:02.808960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:02.809889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:02.812028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:02.815907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING keystone.server.flask.common [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 02 21:02:02.911782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.sql.core [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 21:02:02.911782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 21:02:02.911782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [parameters: {'id': '5b072478169c48fe96f8842bfe94b8ad', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 21:02:02.911782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82094) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5b072478169c48fe96f8842bfe94b8ad.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5b072478169c48fe96f8842bfe94b8ad. Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:02:02.947429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application result.read() Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 02 21:02:02.948355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application yield resource Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise self.value Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application session.commit() Sep 02 21:02:02.949351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self.session.flush() Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application compat.raise_( Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 21:02:02.950225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 21:02:02.951099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application result.read() Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:02:02.951879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [parameters: {'id': '5b072478169c48fe96f8842bfe94b8ad', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:02.952703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:02.955762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5b072478169c48fe96f8842bfe94b8ad. Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:02.958505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 459/936] 10.222.0.71 () {60 vars in 1140 bytes} [Fri Sep 2 21:02:02 2022] POST /identity/v3/projects => generated 262 bytes in 419 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:02.966739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ddeda-07ae-4b8c-aa90-c1acf4ecc804 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:03.063507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:03.185443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:03.198845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ddeda-07ae-4b8c-aa90-c1acf4ecc804 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:03.284762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:03.309883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:03.310896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.311488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.312021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:03.327935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:03.331110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:03.351590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663852-c88c-42b6-b1a2-cf6a07e8cc7e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:03.361502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:03.363811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:03.366451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:03.369505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 478/937] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:03.377559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:03.469425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:03.471155 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.471965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.472774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:03.502951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:03.515139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:03.517338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:03.518676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:03.523819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 460/938] 10.222.0.71 () {56 vars in 1120 bytes} [Fri Sep 2 21:02:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:03.534633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:03.626490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ed7f-c8c2-4e75-aa79-07c3c3ca6e02 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:03.697869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:03.699439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.700197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.701025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:03.702750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:03.703791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:03.706084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:03.744260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 479/939] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:03.802540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2fb1d-0028-4fc3-af4f-9f880a5f5b1e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:03.826441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:03.937272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:03.938712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.939489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.940187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:03.941637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:03.943275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:03.947085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:03.972541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 461/940] 10.222.0.71 () {56 vars in 1115 bytes} [Fri Sep 2 21:02:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:03.982858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.096031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:04.210035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dfe11-da26-42e5-8357-3235a3b26f25 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:04.280789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ea75c-88e4-4d4b-b472-836462dd0003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:04.282424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ea75c-88e4-4d4b-b472-836462dd0003 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.283100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ea75c-88e4-4d4b-b472-836462dd0003 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.283709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ea75c-88e4-4d4b-b472-836462dd0003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.302138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ea75c-88e4-4d4b-b472-836462dd0003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:04.305509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ea75c-88e4-4d4b-b472-836462dd0003 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-1d9ea75c-88e4-4d4b-b472-836462dd0003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:04.337262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:04.339181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:04.341774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:04.341774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:04.341774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:04.344941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 480/941] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:04.354048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.526093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850fae-814e-484b-8424-1f78c6696b50 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.526594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850fae-814e-484b-8424-1f78c6696b50 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.527045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850fae-814e-484b-8424-1f78c6696b50 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.533208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 481/942] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:04.541951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933542df-0bf4-4b2c-a1c9-1f5ae415f893 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.542431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933542df-0bf4-4b2c-a1c9-1f5ae415f893 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.542904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933542df-0bf4-4b2c-a1c9-1f5ae415f893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.565717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086c3c4-3f1a-4368-abac-c51689e68e42 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:04.582438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-933542df-0bf4-4b2c-a1c9-1f5ae415f893 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:04.585390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-933542df-0bf4-4b2c-a1c9-1f5ae415f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:04.681665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:04.682694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.683146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.684013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.685434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:04.686321 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:04.688301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:04.717657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 462/943] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:04.742011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.776868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 482/944] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:04.833705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.031118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c60de9-7772-4e57-8ecd-9e9314d0a880 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.103606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f43ed-f16c-401c-bbfa-9e1e5dbb891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.105231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f43ed-f16c-401c-bbfa-9e1e5dbb891e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.105919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f43ed-f16c-401c-bbfa-9e1e5dbb891e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.106546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f43ed-f16c-401c-bbfa-9e1e5dbb891e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.118974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f43ed-f16c-401c-bbfa-9e1e5dbb891e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.122247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f43ed-f16c-401c-bbfa-9e1e5dbb891e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-dc7f43ed-f16c-401c-bbfa-9e1e5dbb891e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:05.148026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:05.149902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:05.151718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:05.156346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 463/945] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:02:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:05.166015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933542df-0bf4-4b2c-a1c9-1f5ae415f893 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.235022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.316021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812e16c-8b8e-405f-9e42-fcdf2588d1a3 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.316461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812e16c-8b8e-405f-9e42-fcdf2588d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.316841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812e16c-8b8e-405f-9e42-fcdf2588d1a3 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.320049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 464/946] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:05.321650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812e16c-8b8e-405f-9e42-fcdf2588d1a3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.420263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933542df-0bf4-4b2c-a1c9-1f5ae415f893 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.501584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3818-c1e8-4001-92d8-92ed1b254c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.502779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3818-c1e8-4001-92d8-92ed1b254c7e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.503791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3818-c1e8-4001-92d8-92ed1b254c7e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.503791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3818-c1e8-4001-92d8-92ed1b254c7e None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.506328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3818-c1e8-4001-92d8-92ed1b254c7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:05.507099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3818-c1e8-4001-92d8-92ed1b254c7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.510746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3818-c1e8-4001-92d8-92ed1b254c7e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.555500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.561551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 483/947] 10.222.0.71 () {56 vars in 1149 bytes} [Fri Sep 2 21:02:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:05.561551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1128afe-b814-4e3f-8385-19506741e10f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.561551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1128afe-b814-4e3f-8385-19506741e10f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.561551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1128afe-b814-4e3f-8385-19506741e10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.591404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812e16c-8b8e-405f-9e42-fcdf2588d1a3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.597402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f1128afe-b814-4e3f-8385-19506741e10f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:05.600076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f1128afe-b814-4e3f-8385-19506741e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:05.686470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.686470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.686904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.687108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.687982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.690776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:05.710874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:05.712506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:05.714843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 465/948] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:05.717785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.811138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 484/949] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:05.813723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1128afe-b814-4e3f-8385-19506741e10f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.859551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:06.027074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefba23-83cd-4e10-bc66-ad6b30a248f0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.087515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1128afe-b814-4e3f-8385-19506741e10f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.114371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.115532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.116025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.116588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.150952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:06.153995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:06.164972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.166604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.167342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.168181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.170174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:06.170726 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:06.173776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:06.188061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:06.189664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:06.191362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:06.191362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:06.191362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:06.194306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 485/950] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:06.196451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 466/951] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:06.205193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:06.206039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:06.212515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:06.424117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:06.473846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ece4-1157-4285-8553-4f655ffa295b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.501992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670bd66-6139-490f-becb-979fba8ff586 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.565051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.566688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.568273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.569641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.571117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:06.571941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:06.575218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:06.596337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.597637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.598181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.599295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.600568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:06.601157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:06.603783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:06.611344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 467/952] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:06.614585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:06.624849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 486/953] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:06.630285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:06.809574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:06.880084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24ebeb-fe90-42f6-a516-3a357deca012 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.924955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70673aee-50f0-4773-ab7f-d42dcc54ad2a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.963636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.964905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.965216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.965649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.981204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:06.983951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:07.010165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:07.012142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.013005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.013785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.015231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:07.015450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:07.017200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:07.019077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:07.019956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:07.022096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 487/954] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:07.032071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:07.038237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:07.046944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:07.062780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:07.072519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 468/955] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:07.091695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:07.317568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0f063-18cd-421f-8335-00b6bfd35eb5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:07.340015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a3709-1ad1-45d2-923c-4f5bca08b98f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:07.411877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:07.428290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429e43e-5ac1-4acd-9106-7a3162824a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:07.431002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e43e-5ac1-4acd-9106-7a3162824a65 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.431002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e43e-5ac1-4acd-9106-7a3162824a65 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.431453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e43e-5ac1-4acd-9106-7a3162824a65 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.433342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429e43e-5ac1-4acd-9106-7a3162824a65 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:07.434164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429e43e-5ac1-4acd-9106-7a3162824a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:07.436871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429e43e-5ac1-4acd-9106-7a3162824a65 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:07.437131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef503-9da1-400e-babf-dc1687af292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:07.438504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef503-9da1-400e-babf-dc1687af292d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.438504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef503-9da1-400e-babf-dc1687af292d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.438504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef503-9da1-400e-babf-dc1687af292d None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.439126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bef503-9da1-400e-babf-dc1687af292d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:07.439762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bef503-9da1-400e-babf-dc1687af292d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:07.442593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bef503-9da1-400e-babf-dc1687af292d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:07.456934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 469/956] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:07.461100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de887d7-f1f5-4235-813f-1f392cb55fb1 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.461538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de887d7-f1f5-4235-813f-1f392cb55fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.462184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de887d7-f1f5-4235-813f-1f392cb55fb1 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.465378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 470/957] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:07.466338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de887d7-f1f5-4235-813f-1f392cb55fb1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:07.470260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 488/958] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:07.475331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594aa4-2790-4d3c-8bad-e651503937d1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.475792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594aa4-2790-4d3c-8bad-e651503937d1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.476072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594aa4-2790-4d3c-8bad-e651503937d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.513437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-d8594aa4-2790-4d3c-8bad-e651503937d1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:07.522526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d8594aa4-2790-4d3c-8bad-e651503937d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:07.704502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:07.740581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 489/959] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:07.742752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8594aa4-2790-4d3c-8bad-e651503937d1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:07.812428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de887d7-f1f5-4235-813f-1f392cb55fb1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:07.886839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:07.887871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.888434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.890672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.890672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:07.890672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:07.893380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:07.903533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 471/960] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:07.914941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.040914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8594aa4-2790-4d3c-8bad-e651503937d1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.053809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.111115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.116948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.116948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.116948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/4e11476429d84a6ba6ed2b9b71d28507/roles/db6dd05456bf4ae7a5ff75fe009aea4f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.118373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=4e11476429d84a6ba6ed2b9b71d28507, role_id=db6dd05456bf4ae7a5ff75fe009aea4f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.121907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:08.164620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914e19-793a-4478-b69f-ae80cbb89442 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.254128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.255632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.255922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.256394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.257673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.259418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:08.293429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 490/961] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:07 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/4e11476429d84a6ba6ed2b9b71d28507/roles/db6dd05456bf4ae7a5ff75fe009aea4f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:08.294929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.421048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.421378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 472/962] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:08.533480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f046a8-0a9e-410b-a4a0-051c229ec772 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.622789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.623912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.624345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.624798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.625890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.628979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:08.633861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING keystone.server.flask.common [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 02 21:02:08.789698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.sql.core [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 21:02:08.789698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 21:02:08.789698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [parameters: {'user_id': '03a5705c523d4124aa592bbf8a72b46a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 21:02:08.789698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82093) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result.read() Sep 02 21:02:08.805874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:02:08.807670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application yield resource Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise self.value Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application session.commit() Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 21:02:08.809788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.session.flush() Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application compat.raise_( Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 21:02:08.811581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:02:08.820807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application result.read() Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:02:08.822436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [parameters: {'user_id': '03a5705c523d4124aa592bbf8a72b46a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:08.824056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 02 21:02:08.825976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 02 21:02:08.828078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 02 21:02:08.828078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 02 21:02:08.828078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 21:02:08.828078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 21:02:08.828078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 21:02:08.828078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:08.828078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 491/963] 10.222.0.71 () {60 vars in 1131 bytes} [Fri Sep 2 21:02:08 2022] POST /identity/v3/users => generated 160 bytes in 515 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:08.828880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.042256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2b27e-1052-42cc-8246-d0b57cdc6941 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.061937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.099552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7477f82-8cd0-41ef-951c-e618e489c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.100935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477f82-8cd0-41ef-951c-e618e489c703 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.103871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477f82-8cd0-41ef-951c-e618e489c703 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.104836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477f82-8cd0-41ef-951c-e618e489c703 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.122188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477f82-8cd0-41ef-951c-e618e489c703 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.126057 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477f82-8cd0-41ef-951c-e618e489c703 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-f7477f82-8cd0-41ef-951c-e618e489c703 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:09.147860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:09.149825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:09.151680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 473/964] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:09.164946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.399021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4de4a4-7c63-4e35-acbd-b05646f09e56 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.425304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.480710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959dfae-492d-43ac-9460-9105e305b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.482354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959dfae-492d-43ac-9460-9105e305b519 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.483186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959dfae-492d-43ac-9460-9105e305b519 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.483962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959dfae-492d-43ac-9460-9105e305b519 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.485805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959dfae-492d-43ac-9460-9105e305b519 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:09.486697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959dfae-492d-43ac-9460-9105e305b519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.490134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959dfae-492d-43ac-9460-9105e305b519 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.578301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 492/965] 10.222.0.71 () {56 vars in 1101 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:10.179413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857c47-5c59-4cf5-ba98-0a7462fc0ece None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.179413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857c47-5c59-4cf5-ba98-0a7462fc0ece None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.179413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857c47-5c59-4cf5-ba98-0a7462fc0ece None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.182059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 474/966] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:10.190689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737d48-433d-4b99-93fa-58237bc1c83e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.191383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737d48-433d-4b99-93fa-58237bc1c83e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.192475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737d48-433d-4b99-93fa-58237bc1c83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.246509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a0737d48-433d-4b99-93fa-58237bc1c83e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:10.249895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a0737d48-433d-4b99-93fa-58237bc1c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:10.416827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 493/967] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:10.947556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857c47-5c59-4cf5-ba98-0a7462fc0ece None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.211595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857c47-5c59-4cf5-ba98-0a7462fc0ece None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.292653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b6e8f-e7d8-44a0-a808-5906543682f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.293704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b6e8f-e7d8-44a0-a808-5906543682f9 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.294186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b6e8f-e7d8-44a0-a808-5906543682f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.294665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b6e8f-e7d8-44a0-a808-5906543682f9 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.295855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b6e8f-e7d8-44a0-a808-5906543682f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.298517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b6e8f-e7d8-44a0-a808-5906543682f9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.412705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 475/968] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:10 2022] POST /identity/v3/services => generated 242 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:11.670408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5f19-c4a4-4a00-af7b-3dbd7ff619aa None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.671239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5f19-c4a4-4a00-af7b-3dbd7ff619aa None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.671382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5f19-c4a4-4a00-af7b-3dbd7ff619aa None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.673966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 494/969] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:11.684216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17500e37-6d02-4b64-885d-c1c583430855 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.684698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17500e37-6d02-4b64-885d-c1c583430855 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.685201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17500e37-6d02-4b64-885d-c1c583430855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.725259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-17500e37-6d02-4b64-885d-c1c583430855 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:11.733445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-17500e37-6d02-4b64-885d-c1c583430855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:11.793530 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.907998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 476/970] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:11.964244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2deb-1f25-49a4-8394-afec9f2f5035 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.965077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2deb-1f25-49a4-8394-afec9f2f5035 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.965277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2deb-1f25-49a4-8394-afec9f2f5035 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.967862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 495/971] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:11.976973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ea86-cccc-41d4-a067-588286ce2855 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.977408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ea86-cccc-41d4-a067-588286ce2855 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.977844 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ea86-cccc-41d4-a067-588286ce2855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.000610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-3105ea86-cccc-41d4-a067-588286ce2855 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:12.002130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3105ea86-cccc-41d4-a067-588286ce2855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:12.147742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 477/972] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:12.337853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2deb-1f25-49a4-8394-afec9f2f5035 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.534596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.542708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2deb-1f25-49a4-8394-afec9f2f5035 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.587099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ea86-cccc-41d4-a067-588286ce2855 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.587923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.587923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.588122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.588415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.601395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:12.607090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:12.609124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:12.610537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 496/973] 10.222.0.71 () {56 vars in 1120 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:12.618020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.735767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.753084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ea86-cccc-41d4-a067-588286ce2855 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.779253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d06c-989d-4a66-9037-2a22b473b811 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.831032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.832070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.833304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.834426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.835403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.838299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:12.854773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:12.856712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:12.859710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 478/974] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:12.861960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.861960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.862465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.862936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.865055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:12.865962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.866207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.868780 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.889347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 497/975] 10.222.0.71 () {56 vars in 1115 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:12.895934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.934312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.063148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da37dc1-9554-458a-ba32-9f15e5515c9b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.109732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513180e-b7d0-4fac-9572-3671fb030ffc None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.142001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.142001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.142001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.142658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.143195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.143732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.146700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.154811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 479/976] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:13.164797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.190949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.192192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.192409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.192655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.199777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.216165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.216165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:13.241010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:13.242900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:13.244648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:13.244648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:13.244648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:13.244648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 498/977] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:13.251210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.370044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434146d9-77da-46a3-b389-456a50a6878c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.398248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.444688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.445799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.446461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.446936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.448054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.448540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.451010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.463828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 480/978] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:13.465361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.469580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61bcc5-6e83-4e2d-b4cb-9a143e35156f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.542905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.543638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.543931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.544206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.545483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.545886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.548013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.565980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 499/979] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:13.572543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.628920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.663873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588d645-a940-4a20-aff6-86edaf9a5aad None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.730085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.731187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.731626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.732047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.733255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] RBAC: Adding query filter params (interface=admin, service_id=1adc1d41e2cf4d4ca726078e04626045, region_id=RegionOne) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.733733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.736022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.746106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 481/980] 10.222.0.71 () {56 vars in 1249 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/endpoints?service_id=1adc1d41e2cf4d4ca726078e04626045&interface=admin®ion_id=RegionOne => generated 193 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:13.755162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.782010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2bd8d-1c45-451c-942b-bd838ed17b29 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.827604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.837063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.845696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.845696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.845696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.851915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.854083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:13.873132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:13.877402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:13.878673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 500/981] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:13.891689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.991080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd9eb0-04b7-4304-84c2-05f51a413a89 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:14.078854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:14.079630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.079873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.080148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.080873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:14.082905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:14.091103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 482/982] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/services => generated 1727 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:02:14.110887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e91bc4-c7fc-4084-8ef1-5d4c46367c7c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:14.191563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b6f00-17a2-4f43-b038-82bb81be9a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:14.192470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6f00-17a2-4f43-b038-82bb81be9a90 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.192846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6f00-17a2-4f43-b038-82bb81be9a90 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.193133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6f00-17a2-4f43-b038-82bb81be9a90 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.194011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b6f00-17a2-4f43-b038-82bb81be9a90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:14.194314 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b6f00-17a2-4f43-b038-82bb81be9a90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:14.196182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b6f00-17a2-4f43-b038-82bb81be9a90 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:14.246849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 501/983] 10.222.0.71 () {56 vars in 1149 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:14.248649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:14.271262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:14.532423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caaf60-0862-4cef-9d0b-dcfd2b20a0f4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:14.627267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:14.629873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.629873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.631488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.828426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a93f-fd1a-4795-b5c7-3072b2ac5ed9 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.828426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a93f-fd1a-4795-b5c7-3072b2ac5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.829466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a93f-fd1a-4795-b5c7-3072b2ac5ed9 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.831145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:14.833520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 502/984] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:14.833996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:14.841541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47b4a6-92ee-4b32-b468-80db72a10a4b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.842083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47b4a6-92ee-4b32-b468-80db72a10a4b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.842697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47b4a6-92ee-4b32-b468-80db72a10a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.854992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:14.884334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7a47b4a6-92ee-4b32-b468-80db72a10a4b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:14.886294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7a47b4a6-92ee-4b32-b468-80db72a10a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:14.991766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.036194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 503/985] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:15.061551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 483/986] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:14 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:02:15.070954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47b4a6-92ee-4b32-b468-80db72a10a4b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.271767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47b4a6-92ee-4b32-b468-80db72a10a4b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.326741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.328285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.328752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.329209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.368517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.372791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:15.409739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:15.412088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:15.413822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:15.413822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:15.413822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:15.413822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 504/987] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:15.421414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.563334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.623896 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3f032-809e-4844-a278-ee2a1a4b519d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.641511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.642997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.689654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.690670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.691141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.692796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.694067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:15.694595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.697203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.723399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 484/988] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:15.733165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.807710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21eb8-96cc-49fd-bbd0-487a277b5012 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.915796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.918696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.919494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.920206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] PATH_INFO: `/v3/services/compute` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.921563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.924930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:15.950673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:15.952062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:15.953908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 505/989] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:15.962373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.965112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfc6d7-a1f8-4d9d-9cc7-2f6d1d62e8d0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.059187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.060463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.061014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.061511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.077509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.083813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:16.117803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:16.122480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:16.124766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 485/990] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:16.130936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.204224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.236338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.261825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b32a5-f7d4-4ef4-968f-3f77a827752b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.364609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.365705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.366616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.366616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.367855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] RBAC: Adding query filter params (name=compute) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:16.368401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.371114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.397102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 506/991] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:16.398958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808563-052f-4f5c-852b-2f15d590e946 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.399219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.534496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.535495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.537093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.537601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.538856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:16.539359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.542158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.580237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 486/992] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:16.590086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.682175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081cc0b-bc7b-4805-9bc3-407ee01f274a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.762291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.763204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.763599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.764051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.765007 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:16.765353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.767608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.781324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 507/993] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:16.785710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.831535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.841647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.865248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215d829-ec88-4d11-86ba-a910e1ab3075 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.948766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.951167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.952014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.952706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.956124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] RBAC: Adding query filter params (role.id=db6dd05456bf4ae7a5ff75fe009aea4f, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=4e11476429d84a6ba6ed2b9b71d28507) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:16.956681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.962478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.981487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 487/994] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/role_assignments?user.id=4e11476429d84a6ba6ed2b9b71d28507&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=db6dd05456bf4ae7a5ff75fe009aea4f => generated 608 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.010634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a9d51-941c-4f65-9d34-0ab9dd9f7535 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.104399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b35d3-9856-4bc1-8684-65daf2aa5683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.105458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b35d3-9856-4bc1-8684-65daf2aa5683 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.105948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b35d3-9856-4bc1-8684-65daf2aa5683 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.106567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b35d3-9856-4bc1-8684-65daf2aa5683 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.107879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b35d3-9856-4bc1-8684-65daf2aa5683 None admin] RBAC: Adding query filter params (interface=public, service_id=b66c22f6ef374bb9a9429b2434d6e89c, region_id=RegionOne) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.108430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b35d3-9856-4bc1-8684-65daf2aa5683 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.111166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b35d3-9856-4bc1-8684-65daf2aa5683 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.128775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 508/995] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/endpoints?service_id=b66c22f6ef374bb9a9429b2434d6e89c&interface=public®ion_id=RegionOne => generated 194 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.133978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.168901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e16a4-970a-423e-9027-72ab62972b3d None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.169876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e16a4-970a-423e-9027-72ab62972b3d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.171405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e16a4-970a-423e-9027-72ab62972b3d None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.174784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 509/996] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:17.185436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335137-d4c0-4748-8f24-da8f8b60c03b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.186432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335137-d4c0-4748-8f24-da8f8b60c03b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.187150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335137-d4c0-4748-8f24-da8f8b60c03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.224848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-09335137-d4c0-4748-8f24-da8f8b60c03b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:17.226105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-09335137-d4c0-4748-8f24-da8f8b60c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:17.354946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094601f9-234a-449f-8834-0f5e43111276 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.380777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 510/997] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:17.444888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.445708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.446120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.446559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.447597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.449841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.461413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 488/998] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/services => generated 1727 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:02:17.828258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09335137-d4c0-4748-8f24-da8f8b60c03b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.885911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.141833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09335137-d4c0-4748-8f24-da8f8b60c03b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.220430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.221359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.221861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.222206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.223518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.225845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:18.242419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:18.244267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:18.246535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:18.253474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 511/999] 10.222.0.71 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:18.259570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.313681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.489538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c942e7f-3d5e-4e44-8702-28314c0efdbb None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.562297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.563326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.563806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.564277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.565577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:18.566128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.569900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.580174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 489/1000] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.590288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.812640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.850598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc836f85-8078-4a6a-a5f4-6ad9365196b6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.930084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4de39b-9214-4557-8ecc-2b44545b47fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.931140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4de39b-9214-4557-8ecc-2b44545b47fd None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.931621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4de39b-9214-4557-8ecc-2b44545b47fd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.932104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4de39b-9214-4557-8ecc-2b44545b47fd None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.933344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4de39b-9214-4557-8ecc-2b44545b47fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:18.933926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4de39b-9214-4557-8ecc-2b44545b47fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.936622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4de39b-9214-4557-8ecc-2b44545b47fd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.947064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 512/1001] 10.222.0.71 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.956682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.145506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.211707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4fe67-a90e-4871-9edc-c09bfa5e9303 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.296423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c5181-59a8-4f4b-882b-6c752641ebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.297507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5181-59a8-4f4b-882b-6c752641ebf4 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.297947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5181-59a8-4f4b-882b-6c752641ebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.298438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5181-59a8-4f4b-882b-6c752641ebf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.299759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c5181-59a8-4f4b-882b-6c752641ebf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.302547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c5181-59a8-4f4b-882b-6c752641ebf4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.446214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 490/1002] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:20.171239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0508d-37c3-4222-b451-f2c6b701c4ab None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.172028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0508d-37c3-4222-b451-f2c6b701c4ab None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.172178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0508d-37c3-4222-b451-f2c6b701c4ab None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.174864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 513/1003] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:20.189407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a806b1-f176-40a1-bbf4-bd81fc50200a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.189879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a806b1-f176-40a1-bbf4-bd81fc50200a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.190366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a806b1-f176-40a1-bbf4-bd81fc50200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.229182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a3a806b1-f176-40a1-bbf4-bd81fc50200a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:20.229436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a3a806b1-f176-40a1-bbf4-bd81fc50200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:20.403956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 491/1004] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:20.755565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38283f1-7764-486c-a74b-fc55416af2da None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.756007 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38283f1-7764-486c-a74b-fc55416af2da None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.756435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38283f1-7764-486c-a74b-fc55416af2da None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.758802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 514/1005] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:20.767782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a713d-485d-47c1-b265-b9fd695307da None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.768787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a713d-485d-47c1-b265-b9fd695307da None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.769585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a713d-485d-47c1-b265-b9fd695307da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.801600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-371a713d-485d-47c1-b265-b9fd695307da None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:20.803757 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-371a713d-485d-47c1-b265-b9fd695307da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:20.882228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38283f1-7764-486c-a74b-fc55416af2da None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:20.964312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:20.985245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 492/1006] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:21.149236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38283f1-7764-486c-a74b-fc55416af2da None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.260068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.261105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.261546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.262069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] PATH_INFO: `/v3/services/image` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.263051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:21.265570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:21.283546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:21.286524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:21.289249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 515/1007] 10.222.0.71 () {56 vars in 1105 bytes} [Fri Sep 2 21:02:20 2022] GET /identity/v3/services/image => generated 86 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:21.298106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a713d-485d-47c1-b265-b9fd695307da None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.493367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.532843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:21.562029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a713d-485d-47c1-b265-b9fd695307da None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.653286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.654548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.654866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.655238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.656419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] RBAC: Adding query filter params (name=image) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:21.657308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:21.660082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:21.678415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 493/1008] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:21.687705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.782811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b244f-7146-46ed-af51-b5c9af9b6340 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.858715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:21.873506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.882716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.882716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.882716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.882716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:21.882716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:21.899727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:21.901785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:21.904286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 516/1009] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:21.912504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.985517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fef55-f785-43e3-bf27-e864374d2cee None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.074451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.075356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.075356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.075668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.077242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] RBAC: Adding query filter params (type=image) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:22.077786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.081628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.093411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 494/1010] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:22.099402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.176858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2500-0903-4f55-9b13-a01e8b12be95 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.248650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.249600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.249993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.250445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.251517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:22.251948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.255176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.271975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 517/1011] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:22.279868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.528112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91840a-6066-4849-b88d-f3f01b5e9175 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.585667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.608977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c86e1-f8ee-488c-9a5e-61433e548c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.610209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c86e1-f8ee-488c-9a5e-61433e548c42 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.610808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c86e1-f8ee-488c-9a5e-61433e548c42 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.611288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c86e1-f8ee-488c-9a5e-61433e548c42 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.612452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c86e1-f8ee-488c-9a5e-61433e548c42 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:22.613020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c86e1-f8ee-488c-9a5e-61433e548c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.616223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c86e1-f8ee-488c-9a5e-61433e548c42 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.627849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 495/1012] 10.222.0.71 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:22.638064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.657853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf91f4b-3075-4c93-80ff-cd88dff77077 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.658369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf91f4b-3075-4c93-80ff-cd88dff77077 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.658716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf91f4b-3075-4c93-80ff-cd88dff77077 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.660940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 496/1013] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:22.670360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcff317-6b60-46db-8b6f-5df82e94ed3b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.670622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcff317-6b60-46db-8b6f-5df82e94ed3b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.670965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcff317-6b60-46db-8b6f-5df82e94ed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.703787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6dcff317-6b60-46db-8b6f-5df82e94ed3b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:22.706206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6dcff317-6b60-46db-8b6f-5df82e94ed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:22.864952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 497/1014] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:22.915342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6d82-6759-4c08-b351-0aab58aac9fa None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.998924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.999965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.000454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.000976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.002371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.006054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.022611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.128188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 518/1015] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:23.365348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcff317-6b60-46db-8b6f-5df82e94ed3b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.616288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcff317-6b60-46db-8b6f-5df82e94ed3b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.659357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.709952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beeaec-c037-4a8b-ba0b-19f5f81e357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.710988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beeaec-c037-4a8b-ba0b-19f5f81e357f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.711605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beeaec-c037-4a8b-ba0b-19f5f81e357f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.711891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beeaec-c037-4a8b-ba0b-19f5f81e357f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.714272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54beeaec-c037-4a8b-ba0b-19f5f81e357f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.720784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54beeaec-c037-4a8b-ba0b-19f5f81e357f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.720976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 498/1016] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:23.730966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.986901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba424-4766-4a86-bb71-7322ce01b68f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.084746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c80ec-3f6c-467b-97cc-fb028e348256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.085876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c80ec-3f6c-467b-97cc-fb028e348256 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.086324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c80ec-3f6c-467b-97cc-fb028e348256 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.086818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c80ec-3f6c-467b-97cc-fb028e348256 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.088215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c80ec-3f6c-467b-97cc-fb028e348256 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.090950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c80ec-3f6c-467b-97cc-fb028e348256 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.309171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 519/1017] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:23 2022] POST /identity/v3/projects => generated 311 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:02:25.367234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f27cc-a4ae-43a1-b842-89d3ef81e9a0 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.368001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f27cc-a4ae-43a1-b842-89d3ef81e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.368181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f27cc-a4ae-43a1-b842-89d3ef81e9a0 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.370986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 499/1018] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:25.381230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9722-423b-4118-ad98-77d58f7e35c6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.382101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9722-423b-4118-ad98-77d58f7e35c6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.382271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9722-423b-4118-ad98-77d58f7e35c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.416444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-581c9722-423b-4118-ad98-77d58f7e35c6 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:25.418576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-581c9722-423b-4118-ad98-77d58f7e35c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:25.505371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.564859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 520/1019] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:25 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:26.000484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f27cc-a4ae-43a1-b842-89d3ef81e9a0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.239593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f27cc-a4ae-43a1-b842-89d3ef81e9a0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.352916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3707b-b386-4bc7-92d9-d7aa23772907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.353597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3707b-b386-4bc7-92d9-d7aa23772907 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.353950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3707b-b386-4bc7-92d9-d7aa23772907 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.354293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3707b-b386-4bc7-92d9-d7aa23772907 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.355134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3707b-b386-4bc7-92d9-d7aa23772907 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.357765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3707b-b386-4bc7-92d9-d7aa23772907 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.534023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 500/1020] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:25 2022] POST /identity/v3/services => generated 242 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:26.624840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36feef-d331-4b08-855c-3da3cb58d35e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.625508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36feef-d331-4b08-855c-3da3cb58d35e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.626054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36feef-d331-4b08-855c-3da3cb58d35e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.637003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 521/1021] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:26.640434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad4d8-b755-4e76-9fce-455601f1f6c1 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.641839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad4d8-b755-4e76-9fce-455601f1f6c1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.642703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad4d8-b755-4e76-9fce-455601f1f6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.680290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1cfad4d8-b755-4e76-9fce-455601f1f6c1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:26.682940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1cfad4d8-b755-4e76-9fce-455601f1f6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:26.768592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.872765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 501/1022] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:27.354775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36feef-d331-4b08-855c-3da3cb58d35e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.565860 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36feef-d331-4b08-855c-3da3cb58d35e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.608788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4f52e-0887-4378-b1fe-1b253a60cc73 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.609622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4f52e-0887-4378-b1fe-1b253a60cc73 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.609622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4f52e-0887-4378-b1fe-1b253a60cc73 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.612376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 502/1023] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:27.622919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f4fc-f47b-46e8-a1a3-ad3e061f1278 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.623393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f4fc-f47b-46e8-a1a3-ad3e061f1278 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.623873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f4fc-f47b-46e8-a1a3-ad3e061f1278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.651151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.652253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.652793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.653722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.660624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ecc5f4fc-f47b-46e8-a1a3-ad3e061f1278 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:27.663268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ecc5f4fc-f47b-46e8-a1a3-ad3e061f1278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:27.678708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:27.688616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:27.692356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:27.694551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 522/1024] 10.222.0.71 () {56 vars in 1120 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:27.702330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.797239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:27.830042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 503/1025] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:27.950833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58086da5-1070-4696-a8fd-2523a865ef7a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.020075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.021192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.021702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.022198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.023602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:28.024171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.026869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.048186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 523/1026] 10.222.0.71 () {56 vars in 1115 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:28.051533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5f4fc-f47b-46e8-a1a3-ad3e061f1278 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.274385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.283637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5f4fc-f47b-46e8-a1a3-ad3e061f1278 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.345824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.377870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.380516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.380516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.380516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.399592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.402120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:28.428547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:28.436125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:28.437968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:28.437968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:28.437968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:28.437968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 504/1027] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:28.440716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.601419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.610367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b68f3-bb61-4b61-b3cb-0a4039396a1e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.672594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc7d3-ed00-4569-a8c3-330ee312e174 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.692022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.693324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.693773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.694223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.696047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.698307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.704807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 524/1028] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:28.712251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.763932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.765197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.765807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.766350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.767221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:28.767547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.772788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.796705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 505/1029] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:28.812723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.834940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.963278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d03dd-820f-4581-ad3a-ab6dc8d87091 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.035846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.036909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.037329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.037726 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.037883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58779-1644-4665-b1ef-2016ab7ae451 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.038797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.041199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.104084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.104773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.105056 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.105327 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.116290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.118168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:29.146233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:29.147267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:29.148193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:29.149244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 506/1030] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:29.158115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.214611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 525/1031] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:28 2022] POST /identity/v3/users => generated 285 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:29.296959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.354944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fab22-aed5-4f07-b595-dd1b133a56ba None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.413393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9f77-990d-41af-9c53-2edc689cd4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.414400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9f77-990d-41af-9c53-2edc689cd4c5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.414835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9f77-990d-41af-9c53-2edc689cd4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.415145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9f77-990d-41af-9c53-2edc689cd4c5 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.416421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9f77-990d-41af-9c53-2edc689cd4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:29.416998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9f77-990d-41af-9c53-2edc689cd4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.419756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9f77-990d-41af-9c53-2edc689cd4c5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.466561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 507/1032] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:29.477146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.526579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.719962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850538c-1611-41f9-9673-d8e158452ee2 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.802597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.803697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.804313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.804631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.813474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238868ec-4950-4281-8dc6-690eb85ae20a None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.814233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238868ec-4950-4281-8dc6-690eb85ae20a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.814564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238868ec-4950-4281-8dc6-690eb85ae20a None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.821336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 508/1033] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:29.823842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2ec42-0c8c-446e-88b1-1f8596bd8a41 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.824167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2ec42-0c8c-446e-88b1-1f8596bd8a41 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.824445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2ec42-0c8c-446e-88b1-1f8596bd8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.856959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-02e2ec42-0c8c-446e-88b1-1f8596bd8a41 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:29.859029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-02e2ec42-0c8c-446e-88b1-1f8596bd8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:29.953816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.956627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.009072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.040414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 509/1034] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:30.189865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 526/1035] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:02:30.199952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2ec42-0c8c-446e-88b1-1f8596bd8a41 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.321792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.406062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2ec42-0c8c-446e-88b1-1f8596bd8a41 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.472998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.474208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.474622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.475111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.494398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.496868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:30.531540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:30.533741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:30.536096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:30.536096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:30.536096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:30.536096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 510/1036] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:30.543137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.559713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.732493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda4aff-6462-450c-a4ef-f8cf8b7b352d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.776570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab239-89a1-4f02-ac93-622f8cc2de53 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.778093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.795734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.796655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.797096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.797549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.798472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:30.798939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.799367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.802065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.823747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 527/1037] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:30.830766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.849660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.850696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.851264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.851751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] PATH_INFO: `/v3/services/image` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.852981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.855468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:30.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:30.877374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:30.879654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:30.886714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 511/1038] 10.222.0.71 () {56 vars in 1105 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/services/image => generated 86 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:30.888315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.066733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40bc0-164b-4ec3-988e-ebc32834a3cc None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.099727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cd65c-d722-43e0-ac86-8604e3d04436 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.133501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.134694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.135348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.136036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.148543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.151405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.177724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.178711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.179181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.179639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:31.180323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:31.182470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:31.184453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:31.185411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] RBAC: Adding query filter params (name=image) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.185411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.185411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.188094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 528/1039] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:31.193497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 512/1040] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:31.199341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.203316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.288373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.298775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.414548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc390e-2f99-4580-b9f0-2899269bb116 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.444415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239f39c-9702-4f30-818b-eb9978f501f5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.493169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.494486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.495073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.495563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.497359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.497996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.500254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.518552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.520120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.520593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.521088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.522164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] RBAC: Adding query filter params (type=image) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.522698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.525323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.531600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 529/1041] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:31.533795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.536567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 513/1042] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:31.554065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.764715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41c49f-3b03-4394-9358-8450cf569095 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.767440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.798551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913946f-5dbb-4f38-9943-0fb2e54e6690 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.802607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.856590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.857772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.858528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.858528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.867080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] RBAC: Adding query filter params (role.id=db6dd05456bf4ae7a5ff75fe009aea4f, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a55753c439f54804814aca0a3feb96ed) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.867080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.867080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.867692 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167b6c1-9250-41c9-aa02-9247c4fed63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.868782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b6c1-9250-41c9-aa02-9247c4fed63d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.869399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b6c1-9250-41c9-aa02-9247c4fed63d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.869897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b6c1-9250-41c9-aa02-9247c4fed63d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.871122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167b6c1-9250-41c9-aa02-9247c4fed63d None admin] RBAC: Adding query filter params (interface=public, service_id=ac97afc7c8ab44c9a647f4e744f2a4fd, region_id=RegionOne) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.871657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167b6c1-9250-41c9-aa02-9247c4fed63d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.880779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 530/1043] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/role_assignments?user.id=a55753c439f54804814aca0a3feb96ed&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=db6dd05456bf4ae7a5ff75fe009aea4f => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:31.881088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167b6c1-9250-41c9-aa02-9247c4fed63d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.889866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 514/1044] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/endpoints?service_id=ac97afc7c8ab44c9a647f4e744f2a4fd&interface=public®ion_id=RegionOne => generated 194 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:31.899190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:32.146593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2632-afed-402b-a1b4-1e0407646c82 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:32.239149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba25ee-88c0-4163-a03a-79a4b0d6aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:32.240227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba25ee-88c0-4163-a03a-79a4b0d6aa1b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:32.240712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba25ee-88c0-4163-a03a-79a4b0d6aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:32.241230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba25ee-88c0-4163-a03a-79a4b0d6aa1b None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:32.242347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba25ee-88c0-4163-a03a-79a4b0d6aa1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:32.245040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba25ee-88c0-4163-a03a-79a4b0d6aa1b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:32.266411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 531/1045] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/services => generated 1957 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:02:32.363874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc85cc-2e72-42fc-8124-7510d2218130 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:32.365075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc85cc-2e72-42fc-8124-7510d2218130 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:32.365512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc85cc-2e72-42fc-8124-7510d2218130 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:32.368088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 515/1046] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:32.377131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326a18d-f60f-4fce-84c7-a3da909efc42 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:32.377552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326a18d-f60f-4fce-84c7-a3da909efc42 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:32.377982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326a18d-f60f-4fce-84c7-a3da909efc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:32.413045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-3326a18d-f60f-4fce-84c7-a3da909efc42 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:32.414997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3326a18d-f60f-4fce-84c7-a3da909efc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:32.474021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:32.576256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 532/1047] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:32.995510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc85cc-2e72-42fc-8124-7510d2218130 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:33.274967 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc85cc-2e72-42fc-8124-7510d2218130 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:33.344240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:33.345359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:33.345851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:33.346331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:33.375890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:33.383578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:33.390687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:33.392400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 516/1048] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:33.397764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326a18d-f60f-4fce-84c7-a3da909efc42 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:33.640188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326a18d-f60f-4fce-84c7-a3da909efc42 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:33.713875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:33.714931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:33.715421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:33.715909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:33.717215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:33.717751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:33.720465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:33.745255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 533/1049] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:33.747402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:33.829728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:33.990595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115278e0-0b45-4525-b05c-fe84aa35304b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.050747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.051910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.052457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.053004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] PATH_INFO: `/v3/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.084526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] RBAC: Authorizing `identity:get_user(user_id=7f748be96f8c4a49bc5bc3a9e2c5c9fb)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:34.086891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:34.090073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 517/1050] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:02:33 2022] GET /identity/v3/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb => generated 285 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:34.099583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.142476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:34.256113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b59a5-e694-48af-80fc-f79f9d806774 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.324967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d787e31-3a35-4a8a-8173-7f02a75ced23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.325975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d787e31-3a35-4a8a-8173-7f02a75ced23 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.326454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d787e31-3a35-4a8a-8173-7f02a75ced23 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.327016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d787e31-3a35-4a8a-8173-7f02a75ced23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.490462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d787e31-3a35-4a8a-8173-7f02a75ced23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:34.493369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d787e31-3a35-4a8a-8173-7f02a75ced23 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:34.554601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:34.759042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 534/1051] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:02:34.763972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.913250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78652b-62e8-4843-bc59-1958a07c82c9 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.913621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78652b-62e8-4843-bc59-1958a07c82c9 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.913813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78652b-62e8-4843-bc59-1958a07c82c9 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.916119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 535/1052] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:34.929544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348ec9-f402-4abd-b351-6625550b36aa None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.929877 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348ec9-f402-4abd-b351-6625550b36aa None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.930235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348ec9-f402-4abd-b351-6625550b36aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.940887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:34.957935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-af348ec9-f402-4abd-b351-6625550b36aa None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:34.960257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-af348ec9-f402-4abd-b351-6625550b36aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:34.971923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf5c47-2a6e-43f6-a232-639e8b3219f3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.063485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.065448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.066578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.067070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.069609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] RBAC: Authorizing `identity:get_project(project_id=7cde550b2729409c86416ca7419c2c11)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.073972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.089147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 518/1053] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/projects/7cde550b2729409c86416ca7419c2c11 => generated 311 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:35.092444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.126340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 536/1054] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:35.304950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9862ae4-f16d-431e-b02c-28edb31f34c9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.379505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05045a-23a6-4417-a717-8e396d4ea540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.380761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05045a-23a6-4417-a717-8e396d4ea540 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.381254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05045a-23a6-4417-a717-8e396d4ea540 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.381694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05045a-23a6-4417-a717-8e396d4ea540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.382594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05045a-23a6-4417-a717-8e396d4ea540 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=7cde550b2729409c86416ca7419c2c11, user.id=7f748be96f8c4a49bc5bc3a9e2c5c9fb) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:35.383046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05045a-23a6-4417-a717-8e396d4ea540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.384711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05045a-23a6-4417-a717-8e396d4ea540 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.393457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 519/1055] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/role_assignments?user.id=7f748be96f8c4a49bc5bc3a9e2c5c9fb&scope.project.id=7cde550b2729409c86416ca7419c2c11&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:35.458295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414a6d-3dfe-466e-be51-a6dd1991c752 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.458698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414a6d-3dfe-466e-be51-a6dd1991c752 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.458892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21414a6d-3dfe-466e-be51-a6dd1991c752 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.460762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 537/1056] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:35.467587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0900-8e95-4437-8659-3ddaad82316a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.467979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0900-8e95-4437-8659-3ddaad82316a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.468189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0900-8e95-4437-8659-3ddaad82316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.496442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e40e0900-8e95-4437-8659-3ddaad82316a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:35.498381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e40e0900-8e95-4437-8659-3ddaad82316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:35.525607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.555870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414a6d-3dfe-466e-be51-a6dd1991c752 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.637281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 520/1057] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:35.653954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.752162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21414a6d-3dfe-466e-be51-a6dd1991c752 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.822633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.823413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.823830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.824256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.841550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:35.848913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:35.854394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:35.867913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 538/1058] 10.222.0.71 () {56 vars in 1120 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:35.870601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0900-8e95-4437-8659-3ddaad82316a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.087268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.095675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0900-8e95-4437-8659-3ddaad82316a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.184083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.185258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.185771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.186269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.187609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:36.188250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.192172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.215270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 521/1059] 10.222.0.71 () {56 vars in 1115 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:36.221863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.241268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.328485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989fa61-d007-4b86-8304-9ac374f8523a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.358477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.429301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.430647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.430982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.433186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] PATH_INFO: `/v3/services/image` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.433186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.433993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:36.454697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:36.456766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:02:36.459042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:36.460568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dce549-5a0f-4852-9d6e-fa5bdda7c21d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.461615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 539/1060] 10.222.0.71 () {56 vars in 1105 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/services/image => generated 86 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:36.465980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.528452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.529141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.529472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.529831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.561568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.564036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:36.602347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:36.604313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:36.606329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:36.606329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:36.606329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:36.611578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 522/1061] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:36.613347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.746091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080a689-7576-4ec9-946e-8412091d7975 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.781914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.815282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.816161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.816570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.817016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.818585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] RBAC: Adding query filter params (name=image) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:36.818585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.820558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.828355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 540/1062] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:36.836225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.886728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51fbf6-612a-4d79-8087-66f7a793e056 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.952127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.975564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.976751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.977264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.977733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.983239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:36.983239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.983239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.006463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 523/1063] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:37.013498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.080811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb70b2-8114-47f7-81f9-bf26056d5090 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.191570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.191570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.191570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.191570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.192369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] RBAC: Adding query filter params (type=image) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:37.192369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.192369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.192369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 541/1064] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:37.192369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.258194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c5feb-7a12-4ebe-97f7-d80da9272379 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.303022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.329742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.337080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.337080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.337080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.349634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.352577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:37.380479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:37.381718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:37.382723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:37.389086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 524/1065] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:37.395776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.422872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de596a36-29e6-424d-8e53-755f6cb8f408 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.430131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.512602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.513695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.514199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.514618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.515954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.518287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.632380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449682ad-bffb-4b81-a065-0bd0444ace5a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.704609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.705708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.706171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.707204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.708708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:37.709257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.712250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.731057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 542/1066] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:02:37.759616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 525/1067] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:37.766881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.004035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882ffaf-e3c3-49b8-adc3-95766c16a624 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.061486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.062772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.063200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.063643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.079429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.081690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:38.103125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:38.105435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:38.107660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:38.107660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:38.107660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:38.108684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 543/1068] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:38.111983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.197196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:38.297925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dfaa-c354-43f4-92c9-f9ad0b71d48c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.361255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0a6ec-975b-4cea-941d-1269e2f4d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.362489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0a6ec-975b-4cea-941d-1269e2f4d337 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.363008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0a6ec-975b-4cea-941d-1269e2f4d337 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.363511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0a6ec-975b-4cea-941d-1269e2f4d337 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.364804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0a6ec-975b-4cea-941d-1269e2f4d337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:38.365357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0a6ec-975b-4cea-941d-1269e2f4d337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.368016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0a6ec-975b-4cea-941d-1269e2f4d337 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.387556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 526/1069] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:38.395064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.414988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:38.423120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343a306-594e-44f5-8082-5a15f18a53dd None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.423120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343a306-594e-44f5-8082-5a15f18a53dd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.423120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343a306-594e-44f5-8082-5a15f18a53dd None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.440014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 527/1070] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:38.440014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa89b-efcc-4ec7-9ecb-11579d71e2e8 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.440014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa89b-efcc-4ec7-9ecb-11579d71e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.440014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa89b-efcc-4ec7-9ecb-11579d71e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.466617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-dc8fa89b-efcc-4ec7-9ecb-11579d71e2e8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:38.468796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dc8fa89b-efcc-4ec7-9ecb-11579d71e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:38.593131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a23d-1013-4978-a95f-8781c6409582 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.596439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 528/1071] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:38.653799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.654776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.655127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.655486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.668972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.670501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:38.685886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:38.687459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:38.689724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:38.693111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 544/1072] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:38.694734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fa89b-efcc-4ec7-9ecb-11579d71e2e8 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.756067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:38.921723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fa89b-efcc-4ec7-9ecb-11579d71e2e8 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.996358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.997537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.998036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.998507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.999794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:39.000326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.003061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.033775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 529/1073] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:39.036407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.083771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.171428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:39.256341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437070b4-c3c7-436d-baa9-29b717d81082 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.272869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:39.302933 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ff40c-9a74-434c-b806-6e677cc1eae2 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.323639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.323639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.324071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.324568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a55753c439f54804814aca0a3feb96ed/roles/db6dd05456bf4ae7a5ff75fe009aea4f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.329399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=a55753c439f54804814aca0a3feb96ed, role_id=db6dd05456bf4ae7a5ff75fe009aea4f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.330960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.385504 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.386519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.387000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.387475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.404756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:39.413275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:39.416820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:39.418598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 530/1074] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:39.424264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.457728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 545/1075] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:39 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a55753c439f54804814aca0a3feb96ed/roles/db6dd05456bf4ae7a5ff75fe009aea4f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:39.679062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13d13-84af-4a83-8642-9c55b9216b6e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.763445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.764491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.765024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.765342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.766347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:39.766654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.768579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.791142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 531/1076] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:39.803815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:40.070390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386d9b5-b967-4c92-a0c8-ac4f9e9da64c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.129453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:40.145260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.146149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.146609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.147025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] PATH_INFO: `/v3/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.148632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] RBAC: Authorizing `identity:get_user(user_id=7f748be96f8c4a49bc5bc3a9e2c5c9fb)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:40.150343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:40.152718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 546/1077] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb => generated 285 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:40.159835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:40.178213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:40.383703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8279cd4-509c-44be-a8ac-c5225252cd6c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.441949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a3797-a365-4fb9-a219-b82430f33a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.442674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a3797-a365-4fb9-a219-b82430f33a1f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.443050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a3797-a365-4fb9-a219-b82430f33a1f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.443333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a3797-a365-4fb9-a219-b82430f33a1f None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.444631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a3797-a365-4fb9-a219-b82430f33a1f None admin] RBAC: Authorizing `identity:get_project(project_id=7cde550b2729409c86416ca7419c2c11)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:40.447115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a3797-a365-4fb9-a219-b82430f33a1f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:40.452862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 532/1078] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:02:40 2022] GET /identity/v3/projects/7cde550b2729409c86416ca7419c2c11 => generated 311 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:40.459487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:40.468190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7453-0d75-489c-81d4-544f33028d97 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.468615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7453-0d75-489c-81d4-544f33028d97 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.469063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7453-0d75-489c-81d4-544f33028d97 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.473470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 533/1079] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:40.480090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21831c-83d5-4cb2-a698-2db6f02de7be None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.480919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21831c-83d5-4cb2-a698-2db6f02de7be None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.482241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21831c-83d5-4cb2-a698-2db6f02de7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.509684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2c21831c-83d5-4cb2-a698-2db6f02de7be None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:40.511041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2c21831c-83d5-4cb2-a698-2db6f02de7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:40.663634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 534/1080] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:40.680764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72ae56-809c-4150-a8c3-6ed824c5a901 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.764593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.765858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.766306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.766790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.782752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cde550b2729409c86416ca7419c2c11, user_id=7f748be96f8c4a49bc5bc3a9e2c5c9fb, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:40.786371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:40.931563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 547/1081] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:40 2022] PUT /identity/v3/projects/7cde550b2729409c86416ca7419c2c11/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:41.119889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21831c-83d5-4cb2-a698-2db6f02de7be None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.141121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.326280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21831c-83d5-4cb2-a698-2db6f02de7be None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.406558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.408711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.409998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.410635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.551309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:41.553199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:41.566706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.760200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 535/1082] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:02:41.774756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.872703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.964246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922bfe0-c05a-4a9c-9420-b6b2c07393f4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.032386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cf3de-4910-4d59-b443-7dc25bd172ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.032994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf3de-4910-4d59-b443-7dc25bd172ab None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.033271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf3de-4910-4d59-b443-7dc25bd172ab None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.033546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf3de-4910-4d59-b443-7dc25bd172ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.050824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cf3de-4910-4d59-b443-7dc25bd172ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.052820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cf3de-4910-4d59-b443-7dc25bd172ab None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-5a2cf3de-4910-4d59-b443-7dc25bd172ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:42.070924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:42.072872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:42.074049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:42.074049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.074049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:42.074049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 548/1083] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:42.081428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.235373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b3dfa-1430-4e4f-b8d9-6aa05e1128e1 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.257766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.292112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912166-6af4-4af5-826b-9c5ab3457e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.292882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912166-6af4-4af5-826b-9c5ab3457e17 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.293296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912166-6af4-4af5-826b-9c5ab3457e17 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.293695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912166-6af4-4af5-826b-9c5ab3457e17 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.294525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912166-6af4-4af5-826b-9c5ab3457e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:42.294979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912166-6af4-4af5-826b-9c5ab3457e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.296581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912166-6af4-4af5-826b-9c5ab3457e17 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.312371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 536/1084] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:42.604450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea547c-a5cc-4cd5-bbd8-cd91c631e743 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.604969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea547c-a5cc-4cd5-bbd8-cd91c631e743 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.605372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea547c-a5cc-4cd5-bbd8-cd91c631e743 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.607819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 549/1085] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:42.617082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25cf4-27c0-4577-a3e1-1e15065d72df None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.617855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25cf4-27c0-4577-a3e1-1e15065d72df None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.618020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25cf4-27c0-4577-a3e1-1e15065d72df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.645761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0db25cf4-27c0-4577-a3e1-1e15065d72df None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:42.648352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0db25cf4-27c0-4577-a3e1-1e15065d72df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:42.795629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 537/1086] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:43.165643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea547c-a5cc-4cd5-bbd8-cd91c631e743 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.357303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea547c-a5cc-4cd5-bbd8-cd91c631e743 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.370762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.422833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a233c-c532-424b-b47a-20795c86e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.424303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a233c-c532-424b-b47a-20795c86e881 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.425323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a233c-c532-424b-b47a-20795c86e881 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.427094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a233c-c532-424b-b47a-20795c86e881 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.441712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a233c-c532-424b-b47a-20795c86e881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-ac7a233c-c532-424b-b47a-20795c86e881 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:43.449813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:43.451836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:43.454145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 550/1087] 10.222.0.71 () {56 vars in 1120 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:43.462216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db25cf4-27c0-4577-a3e1-1e15065d72df None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.640907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59fdf3-cafd-4de8-9d88-e277b2211ffc None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.641337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59fdf3-cafd-4de8-9d88-e277b2211ffc None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.641804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59fdf3-cafd-4de8-9d88-e277b2211ffc None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.645349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 551/1088] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:43.645862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.652272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b827b5-0624-40da-a8da-f4a623545cea None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.652690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db25cf4-27c0-4577-a3e1-1e15065d72df None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.652883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b827b5-0624-40da-a8da-f4a623545cea None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.653203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b827b5-0624-40da-a8da-f4a623545cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.683862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-55b827b5-0624-40da-a8da-f4a623545cea None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:43.685741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-55b827b5-0624-40da-a8da-f4a623545cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:43.717794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.718681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.719162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.719646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.720895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:43.721215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.723149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.735622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 538/1089] 10.222.0.71 () {56 vars in 1115 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:43.742295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.784779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 552/1090] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:43.899980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38873a5-6577-4ae8-bf1f-5b2dc311503f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.965900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.966863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.967324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.967789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.988637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.991466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:44.018038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:44.021244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:44.022566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:44.022566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:44.022566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:44.022566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 539/1091] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:44.033880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b827b5-0624-40da-a8da-f4a623545cea None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.066985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.096063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.186683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.194453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b827b5-0624-40da-a8da-f4a623545cea None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.252184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498424-f657-408b-90e0-b3da5235b4ab None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.254227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.255559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.256058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.256563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.257861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.258441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.261062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.285340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 553/1092] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.291008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.310068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.310705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.311006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.311354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.327047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:44.333823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:44.335969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:44.337978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 540/1093] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:44.341567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.431652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80de5-0d51-4a05-b6f9-a48a59295553 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.435313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.491443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b86cf-2c30-4d45-9070-4597aa06a852 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.500299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.501323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.501784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.502319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.517718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.521053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.541468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.542230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.542603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.542974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.543767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:44.544083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:44.545960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:44.547834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:44.548943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.549102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 554/1094] 10.222.0.71 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:44.549230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.555906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.560410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 541/1095] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:44.569782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.580699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.735202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721686d5-d20c-4301-9094-c2a0ac3ce95a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.743628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a41f7-ec97-4225-b163-b15572a562db None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.788459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.789014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.789297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.789575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.790419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.790723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.792220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.806682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.807742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.808103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.808459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] PATH_INFO: `/v3/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.810079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] RBAC: Authorizing `identity:get_user(user_id=7f748be96f8c4a49bc5bc3a9e2c5c9fb)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.812575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.816159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 542/1096] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/users/7f748be96f8c4a49bc5bc3a9e2c5c9fb => generated 285 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:44.820929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 555/1097] 10.222.0.71 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.826177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.827140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.831844 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.968462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.995289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd927c5-eb8f-4445-8317-75baef438590 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.014371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31497-d958-499b-bc2a-422cec3f62b5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.071067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.071960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.072425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.072903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.074194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.075147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.075577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.076005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.187195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.188800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.192506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.195338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.199245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:45.320095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:45.340667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 543/1098] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:02:45.348543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:45.349008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 556/1099] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:02:45.356173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:45.512258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3707938-1fa0-4364-ba81-63ccd89b4ffe None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.514100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:45.527688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49699902-769c-4df0-832c-c85a9a3bb2d6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.553941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.554666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.555002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.555343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.573548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.575249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.575698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.576781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.577283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.577788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.579892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] RBAC: Authorizing `identity:get_project(project_id=7cde550b2729409c86416ca7419c2c11)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.582729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.586421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 557/1100] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:02:45 2022] GET /identity/v3/projects/7cde550b2729409c86416ca7419c2c11 => generated 311 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:45.593875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:45.594219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:45.595179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:45.596105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:45.596105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:45.596105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:02:45.596105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 544/1101] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:45.603694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:45.667008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:45.766678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561616-8b22-4acd-84cd-44cae5757102 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.792378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96d7e-37bf-4fff-9bc7-7c78a5f75fa4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.816276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.817219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.817448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.817725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.818497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=7cde550b2729409c86416ca7419c2c11, user.id=7f748be96f8c4a49bc5bc3a9e2c5c9fb) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:45.818805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.820285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.832788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 558/1102] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:45 2022] GET /identity/v3/role_assignments?user.id=7f748be96f8c4a49bc5bc3a9e2c5c9fb&scope.project.id=7cde550b2729409c86416ca7419c2c11&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:45.867574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.868560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.869093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.869590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.870849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:45.871405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.874308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.904434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 545/1103] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:45.914754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:46.088969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eccfc-e731-4211-b664-8f6d2742f690 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:46.101345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:46.142679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:46.143325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:46.144317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:46.145063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:46.155934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:46.158536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:46.174637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:46.176054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:02:46.177262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 559/1104] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:46.183098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:46.202658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:46.326048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b6b9-49b0-4b89-b764-5a1f584beed3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:46.370889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8668a-d654-4bb6-bd17-e0e1de3224ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:46.371965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8668a-d654-4bb6-bd17-e0e1de3224ce None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:46.372448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8668a-d654-4bb6-bd17-e0e1de3224ce None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:46.373001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8668a-d654-4bb6-bd17-e0e1de3224ce None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:46.374333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8668a-d654-4bb6-bd17-e0e1de3224ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:46.374883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8668a-d654-4bb6-bd17-e0e1de3224ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:46.377382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8668a-d654-4bb6-bd17-e0e1de3224ce None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:46.392481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 546/1105] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:46.399787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:46.531015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032bd62-4506-4872-870b-72d41e531044 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:46.573683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016cde7-ea05-4513-bfb9-2695ec22c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:46.574317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016cde7-ea05-4513-bfb9-2695ec22c043 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:46.574600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016cde7-ea05-4513-bfb9-2695ec22c043 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:46.574880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016cde7-ea05-4513-bfb9-2695ec22c043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:46.576237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016cde7-ea05-4513-bfb9-2695ec22c043 None admin] RBAC: Adding query filter params (role.id=db6dd05456bf4ae7a5ff75fe009aea4f, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a55753c439f54804814aca0a3feb96ed) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:46.576237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016cde7-ea05-4513-bfb9-2695ec22c043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:46.577574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016cde7-ea05-4513-bfb9-2695ec22c043 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:46.586124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 560/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:46 2022] GET /identity/v3/role_assignments?user.id=a55753c439f54804814aca0a3feb96ed&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=db6dd05456bf4ae7a5ff75fe009aea4f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:48.102966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10255a67-8417-4b67-b6ef-6fe6270c5f2a None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.103598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10255a67-8417-4b67-b6ef-6fe6270c5f2a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.103872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10255a67-8417-4b67-b6ef-6fe6270c5f2a None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.105283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 547/1107] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:48.111417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9df1-06ff-408a-bbd4-a36e0a8e9d0a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.111945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9df1-06ff-408a-bbd4-a36e0a8e9d0a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.111945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9df1-06ff-408a-bbd4-a36e0a8e9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.132936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b0dc9df1-06ff-408a-bbd4-a36e0a8e9d0a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:48.134233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b0dc9df1-06ff-408a-bbd4-a36e0a8e9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:48.164171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.209420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 561/1108] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:48.492673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10255a67-8417-4b67-b6ef-6fe6270c5f2a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.656537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.720467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10255a67-8417-4b67-b6ef-6fe6270c5f2a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.802837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b64573-cad8-4c1d-96d9-8a48b30258f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.803751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64573-cad8-4c1d-96d9-8a48b30258f0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.804083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64573-cad8-4c1d-96d9-8a48b30258f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.804549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64573-cad8-4c1d-96d9-8a48b30258f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.806257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b64573-cad8-4c1d-96d9-8a48b30258f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.808916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b64573-cad8-4c1d-96d9-8a48b30258f0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.811818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 548/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:48.819172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc9df1-06ff-408a-bbd4-a36e0a8e9d0a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:49.035673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc9df1-06ff-408a-bbd4-a36e0a8e9d0a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.097555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa27c6-18c4-45be-b39b-fde9b3ded433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.098594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa27c6-18c4-45be-b39b-fde9b3ded433 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.099008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa27c6-18c4-45be-b39b-fde9b3ded433 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.099412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa27c6-18c4-45be-b39b-fde9b3ded433 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.100430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa27c6-18c4-45be-b39b-fde9b3ded433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.102986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa27c6-18c4-45be-b39b-fde9b3ded433 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.367422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 562/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:48 2022] POST /identity/v3/users => generated 286 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:51.817329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550813-d072-47fe-a466-9c2a62ea033b None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.817920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550813-d072-47fe-a466-9c2a62ea033b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.818018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550813-d072-47fe-a466-9c2a62ea033b None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.819385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 549/1111] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:51.825627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffafd8-f031-4d5e-977d-f6121d188c86 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.826432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffafd8-f031-4d5e-977d-f6121d188c86 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.826432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffafd8-f031-4d5e-977d-f6121d188c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.846935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b5ffafd8-f031-4d5e-977d-f6121d188c86 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:51.848160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b5ffafd8-f031-4d5e-977d-f6121d188c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:51.863935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:51.929037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 563/1112] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:52.279706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90550813-d072-47fe-a466-9c2a62ea033b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.434527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90550813-d072-47fe-a466-9c2a62ea033b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:52.476427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:52.477119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.477545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.477875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] PATH_INFO: `/v3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.480170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] RBAC: Authorizing `identity:get_role(role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:52.482262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:52.484603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 550/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 223 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:52.494189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffafd8-f031-4d5e-977d-f6121d188c86 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.636267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffafd8-f031-4d5e-977d-f6121d188c86 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:52.676254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:52.677023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.677372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.677654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] PATH_INFO: `/v3/users/ee3564895cee43358538412957370160` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.694423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=ee3564895cee43358538412957370160)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:52.695930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:52.697820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 564/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/users/ee3564895cee43358538412957370160 => generated 286 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:52.705136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.725361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:52.892995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27724ab-6e3a-4565-8cd2-d28e7fafd0a4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:52.962910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:52.963634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.963920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.964198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.052583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.054406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.069604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.199216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 551/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:02:53.205833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.215526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.360011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf54ba9-68b9-47fb-a8fb-1d4055efe1f6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.430298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba400ae-55dc-45d4-99f0-eb6e765df92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.431004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba400ae-55dc-45d4-99f0-eb6e765df92d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.431364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba400ae-55dc-45d4-99f0-eb6e765df92d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.431644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba400ae-55dc-45d4-99f0-eb6e765df92d None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.433056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba400ae-55dc-45d4-99f0-eb6e765df92d None admin] RBAC: Authorizing `identity:get_project(project_id=7cde550b2729409c86416ca7419c2c11)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.436984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba400ae-55dc-45d4-99f0-eb6e765df92d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.439363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 565/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/projects/7cde550b2729409c86416ca7419c2c11 => generated 311 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:53.451098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.635682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec806c5-65d0-42bb-bba5-a25457aecec3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.663391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.712356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0effff-df85-4b43-9377-b89281d0a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.713319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0effff-df85-4b43-9377-b89281d0a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.713781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0effff-df85-4b43-9377-b89281d0a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.714280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0effff-df85-4b43-9377-b89281d0a9f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.715596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0effff-df85-4b43-9377-b89281d0a9f6 None admin] RBAC: Adding query filter params (role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=7cde550b2729409c86416ca7419c2c11, user.id=ee3564895cee43358538412957370160) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:53.716137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0effff-df85-4b43-9377-b89281d0a9f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.718998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0effff-df85-4b43-9377-b89281d0a9f6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.730268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 552/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/role_assignments?user.id=ee3564895cee43358538412957370160&scope.project.id=7cde550b2729409c86416ca7419c2c11&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:56.463048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4ec2-6f3e-4b29-942f-53450bf409e1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:56.463669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4ec2-6f3e-4b29-942f-53450bf409e1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:56.463797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4ec2-6f3e-4b29-942f-53450bf409e1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:56.465442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 566/1118] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:56.473856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526022-1494-4a8e-845f-b09184b6fa0e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:56.475375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526022-1494-4a8e-845f-b09184b6fa0e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:56.475375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c526022-1494-4a8e-845f-b09184b6fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:56.496060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1c526022-1494-4a8e-845f-b09184b6fa0e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:56.497320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1c526022-1494-4a8e-845f-b09184b6fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:56.602795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 553/1119] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:57.105924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4ec2-6f3e-4b29-942f-53450bf409e1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.217336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:57.270114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4ec2-6f3e-4b29-942f-53450bf409e1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.326673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.327437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.327763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.328114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] PATH_INFO: `/v3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.329987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] RBAC: Authorizing `identity:get_role(role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.331642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.333262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 567/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 223 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:57.340228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526022-1494-4a8e-845f-b09184b6fa0e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.513126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c526022-1494-4a8e-845f-b09184b6fa0e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.516397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:57.567766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.568710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.569175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.569595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] PATH_INFO: `/v3/users/ee3564895cee43358538412957370160` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.571453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ee3564895cee43358538412957370160)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.574015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.576754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 554/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/users/ee3564895cee43358538412957370160 => generated 286 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:57.585892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.739232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da36d26-baa2-4fbb-b2e1-960fa90feb8b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.797242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2fac6-4c81-4df0-bc9e-bfe3bdb7d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.797862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2fac6-4c81-4df0-bc9e-bfe3bdb7d684 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.798200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2fac6-4c81-4df0-bc9e-bfe3bdb7d684 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.798556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2fac6-4c81-4df0-bc9e-bfe3bdb7d684 None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.801346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2fac6-4c81-4df0-bc9e-bfe3bdb7d684 None admin] RBAC: Authorizing `identity:get_project(project_id=7cde550b2729409c86416ca7419c2c11)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.802974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2fac6-4c81-4df0-bc9e-bfe3bdb7d684 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.804889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 568/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/projects/7cde550b2729409c86416ca7419c2c11 => generated 311 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:57.811483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.930891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15109aa-8ffd-4022-88fd-cae86742d8c2 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.969555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286dfcf-a9e2-4aa4-bf9b-781888ef1eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.970233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286dfcf-a9e2-4aa4-bf9b-781888ef1eb0 None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.970507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286dfcf-a9e2-4aa4-bf9b-781888ef1eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.970779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286dfcf-a9e2-4aa4-bf9b-781888ef1eb0 None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11/users/ee3564895cee43358538412957370160/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.973715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286dfcf-a9e2-4aa4-bf9b-781888ef1eb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cde550b2729409c86416ca7419c2c11, user_id=ee3564895cee43358538412957370160, role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.975180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286dfcf-a9e2-4aa4-bf9b-781888ef1eb0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.073378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 555/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:57 2022] PUT /identity/v3/projects/7cde550b2729409c86416ca7419c2c11/users/ee3564895cee43358538412957370160/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:03:00.248380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8516d-82b2-4c89-b300-6c6eb4393843 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:00.249413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8516d-82b2-4c89-b300-6c6eb4393843 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:00.249413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8516d-82b2-4c89-b300-6c6eb4393843 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:00.250487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 569/1124] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:00.257407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6db79-6d33-4c51-b83a-87363e3aaa14 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:00.258262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6db79-6d33-4c51-b83a-87363e3aaa14 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:00.258262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6db79-6d33-4c51-b83a-87363e3aaa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:00.286044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-3ff6db79-6d33-4c51-b83a-87363e3aaa14 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:00.288106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3ff6db79-6d33-4c51-b83a-87363e3aaa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:00.331740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:00.398180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 556/1125] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:00.709111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8516d-82b2-4c89-b300-6c6eb4393843 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:00.728636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:00.858665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8516d-82b2-4c89-b300-6c6eb4393843 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:00.912862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:00.913744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:00.914030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:00.914474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] PATH_INFO: `/v3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:00.916440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] RBAC: Authorizing `identity:get_role(role_id=892fbc868b6a4d7fb46c43da5fcfc5bd)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:00.918142 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:00.919609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 570/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:00 2022] GET /identity/v3/roles/892fbc868b6a4d7fb46c43da5fcfc5bd => generated 223 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:00.928513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6db79-6d33-4c51-b83a-87363e3aaa14 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:01.078881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6db79-6d33-4c51-b83a-87363e3aaa14 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:01.120077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:01.120704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.121012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.121282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] PATH_INFO: `/v3/users/ee3564895cee43358538412957370160` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.122488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] RBAC: Authorizing `identity:get_user(user_id=ee3564895cee43358538412957370160)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:01.123923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:01.125660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 557/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:00 2022] GET /identity/v3/users/ee3564895cee43358538412957370160 => generated 286 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:01.132613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:01.273747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:01.317041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a500-e3f3-4472-bb6a-49eeff61acc7 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:01.370467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:01.371019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.371313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.371585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.452248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:01.453791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:01.582281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:01.607658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 571/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:03:01.614581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:01.660101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:01.761774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ed8c9-a63f-4384-b959-ff456e31337e None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:01.817112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf612b8-48e5-4227-a217-a119ddd4a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:01.817773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf612b8-48e5-4227-a217-a119ddd4a73e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.818109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf612b8-48e5-4227-a217-a119ddd4a73e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.818389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf612b8-48e5-4227-a217-a119ddd4a73e None admin] PATH_INFO: `/v3/projects/7cde550b2729409c86416ca7419c2c11` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.819739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf612b8-48e5-4227-a217-a119ddd4a73e None admin] RBAC: Authorizing `identity:get_project(project_id=7cde550b2729409c86416ca7419c2c11)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:01.821456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf612b8-48e5-4227-a217-a119ddd4a73e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:01.823266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 558/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:01 2022] GET /identity/v3/projects/7cde550b2729409c86416ca7419c2c11 => generated 311 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:01.829794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:01.943566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df9ad-8428-466b-a010-1cef14a43181 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:01.993114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7a48-422b-42d8-99e7-0d1123404bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:01.993745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7a48-422b-42d8-99e7-0d1123404bdf None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.994025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7a48-422b-42d8-99e7-0d1123404bdf None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.994307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7a48-422b-42d8-99e7-0d1123404bdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.995175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c7a48-422b-42d8-99e7-0d1123404bdf None admin] RBAC: Adding query filter params (role.id=892fbc868b6a4d7fb46c43da5fcfc5bd, scope.project.id=7cde550b2729409c86416ca7419c2c11, user.id=ee3564895cee43358538412957370160) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:01.995490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c7a48-422b-42d8-99e7-0d1123404bdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:01.997005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c7a48-422b-42d8-99e7-0d1123404bdf None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:02.007275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 572/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:01 2022] GET /identity/v3/role_assignments?user.id=ee3564895cee43358538412957370160&scope.project.id=7cde550b2729409c86416ca7419c2c11&role.id=892fbc868b6a4d7fb46c43da5fcfc5bd => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:04.638276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4504ec-e627-48b1-8dfb-b80ec34d13d8 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.639175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4504ec-e627-48b1-8dfb-b80ec34d13d8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.639175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4504ec-e627-48b1-8dfb-b80ec34d13d8 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.641010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 559/1131] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:04.651504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12262ceb-bca0-4218-a442-f2d8ade318a0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.652276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12262ceb-bca0-4218-a442-f2d8ade318a0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.652276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12262ceb-bca0-4218-a442-f2d8ade318a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.683548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-12262ceb-bca0-4218-a442-f2d8ade318a0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:04.685684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-12262ceb-bca0-4218-a442-f2d8ade318a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:04.754471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:04.795601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 573/1132] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:05.140992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4504ec-e627-48b1-8dfb-b80ec34d13d8 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:05.292605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:05.299118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4504ec-e627-48b1-8dfb-b80ec34d13d8 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:05.359981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76f01-6993-4dd8-ba5a-6ff4262b9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:05.360884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76f01-6993-4dd8-ba5a-6ff4262b9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:05.361312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76f01-6993-4dd8-ba5a-6ff4262b9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:05.361988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76f01-6993-4dd8-ba5a-6ff4262b9ea6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:05.364919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc76f01-6993-4dd8-ba5a-6ff4262b9ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:05.367612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc76f01-6993-4dd8-ba5a-6ff4262b9ea6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:05.370439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 560/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:05.380487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12262ceb-bca0-4218-a442-f2d8ade318a0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:05.561181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12262ceb-bca0-4218-a442-f2d8ade318a0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:05.620288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c214b5-a302-4939-b94d-4db434fcda14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:05.621306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c214b5-a302-4939-b94d-4db434fcda14 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:05.621732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c214b5-a302-4939-b94d-4db434fcda14 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:05.622150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c214b5-a302-4939-b94d-4db434fcda14 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:05.623304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c214b5-a302-4939-b94d-4db434fcda14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:05.625880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c214b5-a302-4939-b94d-4db434fcda14 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:05.765323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 574/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:03:05 2022] POST /identity/v3/projects => generated 311 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:08.655592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5a27-3ee8-4767-8f12-a60819a6e3fb None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:08.656329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5a27-3ee8-4767-8f12-a60819a6e3fb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:08.656554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5a27-3ee8-4767-8f12-a60819a6e3fb None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:08.659816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 561/1135] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:08.667068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc56b-6710-4429-91d6-4ce89af6e83a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:08.667645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc56b-6710-4429-91d6-4ce89af6e83a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:08.667645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc56b-6710-4429-91d6-4ce89af6e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:08.692636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-baccc56b-6710-4429-91d6-4ce89af6e83a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:08.693907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-baccc56b-6710-4429-91d6-4ce89af6e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:08.715949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:08.788290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 575/1136] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:09.094799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f5a27-3ee8-4767-8f12-a60819a6e3fb None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:09.288522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f5a27-3ee8-4767-8f12-a60819a6e3fb None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:09.352245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff9471-5c7b-426d-b89f-a2de2ee5a355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:09.353168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9471-5c7b-426d-b89f-a2de2ee5a355 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.353591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9471-5c7b-426d-b89f-a2de2ee5a355 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.353998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9471-5c7b-426d-b89f-a2de2ee5a355 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.355948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff9471-5c7b-426d-b89f-a2de2ee5a355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:09.358475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff9471-5c7b-426d-b89f-a2de2ee5a355 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:09.361392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 562/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:09.370910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc56b-6710-4429-91d6-4ce89af6e83a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:09.522953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc56b-6710-4429-91d6-4ce89af6e83a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:09.587806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999fdd1-8d3b-4805-8395-b99497bd9292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:09.588810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999fdd1-8d3b-4805-8395-b99497bd9292 None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.589245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999fdd1-8d3b-4805-8395-b99497bd9292 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.589658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999fdd1-8d3b-4805-8395-b99497bd9292 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.590746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999fdd1-8d3b-4805-8395-b99497bd9292 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:09.593272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999fdd1-8d3b-4805-8395-b99497bd9292 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:09.802669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 576/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:03:09 2022] POST /identity/v3/users => generated 286 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:12.178685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ba0d-1553-4041-9e27-d6d427d6b295 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.179470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ba0d-1553-4041-9e27-d6d427d6b295 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.179632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ba0d-1553-4041-9e27-d6d427d6b295 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.181303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 563/1139] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:12.192647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4f99b-2d8e-48e8-aa56-e7620109f887 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.193568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4f99b-2d8e-48e8-aa56-e7620109f887 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.194522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4f99b-2d8e-48e8-aa56-e7620109f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.226939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f8f4f99b-2d8e-48e8-aa56-e7620109f887 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:12.228358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f8f4f99b-2d8e-48e8-aa56-e7620109f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:12.232190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:12.353190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 577/1140] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:12.662410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ba0d-1553-4041-9e27-d6d427d6b295 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:12.712937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:12.816446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ba0d-1553-4041-9e27-d6d427d6b295 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:12.858788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:12.859726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.860173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.860639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.886955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:12.894913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:12.897003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:03:12.899084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 564/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:12.904372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4f99b-2d8e-48e8-aa56-e7620109f887 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:13.097124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4f99b-2d8e-48e8-aa56-e7620109f887 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:13.155500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:13.156265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.156645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.157215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.158413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:13.158923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:13.161534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:13.179054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 578/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:13.188836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:13.341546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:13.358754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834812-15a0-47b9-a628-35a99b94279b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:13.406503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:13.407309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.407644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.408023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] PATH_INFO: `/v3/users/354b7fec663144a4a7a667c3b1449a38` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.426831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] RBAC: Authorizing `identity:get_user(user_id=354b7fec663144a4a7a667c3b1449a38)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:13.428377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:13.430192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 565/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:13 2022] GET /identity/v3/users/354b7fec663144a4a7a667c3b1449a38 => generated 286 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:13.437878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:13.443371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:13.584223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ec059-b120-486e-b2c5-e307a207f108 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:13.636596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:13.637374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.637659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.638120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.741827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:13.744330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:13.747839 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:13.948541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 579/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:13.958510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.155046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbce4a-b905-4b1f-9360-faaadd02ec07 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.223183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac65784-2f23-4bc3-a2e7-0cdb00abfeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.223921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65784-2f23-4bc3-a2e7-0cdb00abfeeb None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.224106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65784-2f23-4bc3-a2e7-0cdb00abfeeb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.224382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65784-2f23-4bc3-a2e7-0cdb00abfeeb None admin] PATH_INFO: `/v3/projects/be364e11e84b479c94f418acb2c4cf6d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.225663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac65784-2f23-4bc3-a2e7-0cdb00abfeeb None admin] RBAC: Authorizing `identity:get_project(project_id=be364e11e84b479c94f418acb2c4cf6d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:14.227129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac65784-2f23-4bc3-a2e7-0cdb00abfeeb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:14.228895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 566/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:13 2022] GET /identity/v3/projects/be364e11e84b479c94f418acb2c4cf6d => generated 311 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:14.235607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.394699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f600-3aac-466d-af3d-911c437e2797 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.397307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:14.447873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb759a28-2ed3-48c2-b91f-6c3b18940bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.448953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759a28-2ed3-48c2-b91f-6c3b18940bfc None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.449158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759a28-2ed3-48c2-b91f-6c3b18940bfc None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.449343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb759a28-2ed3-48c2-b91f-6c3b18940bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.450195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759a28-2ed3-48c2-b91f-6c3b18940bfc None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=be364e11e84b479c94f418acb2c4cf6d, user.id=354b7fec663144a4a7a667c3b1449a38) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:14.450514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759a28-2ed3-48c2-b91f-6c3b18940bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:14.452355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb759a28-2ed3-48c2-b91f-6c3b18940bfc None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:14.462610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 580/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:14 2022] GET /identity/v3/role_assignments?user.id=354b7fec663144a4a7a667c3b1449a38&scope.project.id=be364e11e84b479c94f418acb2c4cf6d&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:16.922372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bee0d-a5be-4a70-8ad4-0838436d7440 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.922957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bee0d-a5be-4a70-8ad4-0838436d7440 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.923185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bee0d-a5be-4a70-8ad4-0838436d7440 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.926965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 567/1147] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:16.932630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788112f-cf25-4b67-94ff-078d968e1fd0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.933247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788112f-cf25-4b67-94ff-078d968e1fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.933247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788112f-cf25-4b67-94ff-078d968e1fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.954141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f788112f-cf25-4b67-94ff-078d968e1fd0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:16.955714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f788112f-cf25-4b67-94ff-078d968e1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:17.037892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 581/1148] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:17.333964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bee0d-a5be-4a70-8ad4-0838436d7440 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:17.363653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:17.469563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bee0d-a5be-4a70-8ad4-0838436d7440 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:17.511220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:17.511926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:17.512264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:17.512582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:17.524176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:17.529154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:17.531190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:03:17.533272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 568/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:17.540229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788112f-cf25-4b67-94ff-078d968e1fd0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:17.695975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:17.708844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788112f-cf25-4b67-94ff-078d968e1fd0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:17.768299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:17.769180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:17.769476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:17.769752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:17.770731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:17.771199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:17.773315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:17.785000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 582/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:17.793336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:17.907629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:17.931091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21941c-48cd-4979-b9bd-2a06bf0229f7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:17.976189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:17.976865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:17.977147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:17.977420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] PATH_INFO: `/v3/users/354b7fec663144a4a7a667c3b1449a38` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:17.978568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] RBAC: Authorizing `identity:get_user(user_id=354b7fec663144a4a7a667c3b1449a38)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:17.980064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:17.981706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 569/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:17 2022] GET /identity/v3/users/354b7fec663144a4a7a667c3b1449a38 => generated 286 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:17.989323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:18.156884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9dac4-fb92-410c-89af-26f8d5f57510 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:18.207097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c821983-9507-43a3-a0ce-cd3f190024d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:18.207751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821983-9507-43a3-a0ce-cd3f190024d7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.208035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821983-9507-43a3-a0ce-cd3f190024d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.208312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821983-9507-43a3-a0ce-cd3f190024d7 None admin] PATH_INFO: `/v3/projects/be364e11e84b479c94f418acb2c4cf6d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.209601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c821983-9507-43a3-a0ce-cd3f190024d7 None admin] RBAC: Authorizing `identity:get_project(project_id=be364e11e84b479c94f418acb2c4cf6d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:18.211078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c821983-9507-43a3-a0ce-cd3f190024d7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:18.213100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 583/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:17 2022] GET /identity/v3/projects/be364e11e84b479c94f418acb2c4cf6d => generated 311 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:18.221507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:18.380589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891c47-fc28-42b0-88cf-5f3cc36e9e75 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:18.439914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd255-1cac-4b8f-a346-72c3035656eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:18.441133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd255-1cac-4b8f-a346-72c3035656eb None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.441670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd255-1cac-4b8f-a346-72c3035656eb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.442139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd255-1cac-4b8f-a346-72c3035656eb None admin] PATH_INFO: `/v3/projects/be364e11e84b479c94f418acb2c4cf6d/users/354b7fec663144a4a7a667c3b1449a38/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.445743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd255-1cac-4b8f-a346-72c3035656eb None admin] RBAC: Authorizing `identity:create_grant(project_id=be364e11e84b479c94f418acb2c4cf6d, user_id=354b7fec663144a4a7a667c3b1449a38, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:18.448432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd255-1cac-4b8f-a346-72c3035656eb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:18.592960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 570/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:03:18 2022] PUT /identity/v3/projects/be364e11e84b479c94f418acb2c4cf6d/users/354b7fec663144a4a7a667c3b1449a38/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:03:21.163172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417083-eac0-4541-bcb8-fc23a448e530 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:21.163990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417083-eac0-4541-bcb8-fc23a448e530 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:21.163990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417083-eac0-4541-bcb8-fc23a448e530 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:21.165938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 584/1154] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:21.174889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08481ad-09ec-452f-8394-b1ab5fe2afad None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:21.175686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08481ad-09ec-452f-8394-b1ab5fe2afad None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:21.175686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08481ad-09ec-452f-8394-b1ab5fe2afad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:21.200948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c08481ad-09ec-452f-8394-b1ab5fe2afad None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:21.202276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c08481ad-09ec-452f-8394-b1ab5fe2afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:21.205633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:21.302462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 571/1155] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:21.604412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417083-eac0-4541-bcb8-fc23a448e530 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:21.646342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:21.747267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417083-eac0-4541-bcb8-fc23a448e530 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:21.803203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:21.803852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:21.804138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:21.804415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:21.818246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:21.823133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:21.824422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:03:21.825428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 585/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:21.832443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08481ad-09ec-452f-8394-b1ab5fe2afad None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:21.966242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08481ad-09ec-452f-8394-b1ab5fe2afad None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.034833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.035456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.035725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.035999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.036684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:22.037041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.038540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:22.045073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:22.050465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 572/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:22.058127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.207963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:22.231735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a85035-e680-488e-b51b-5a5b7b58ec27 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.310102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.311712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.312220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.312722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] PATH_INFO: `/v3/users/354b7fec663144a4a7a667c3b1449a38` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.315962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] RBAC: Authorizing `identity:get_user(user_id=354b7fec663144a4a7a667c3b1449a38)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.318854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:22.322079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 586/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/users/354b7fec663144a4a7a667c3b1449a38 => generated 286 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:22.332110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.458472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf367316-0e9c-442a-bfbc-5f7bf2832d78 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.508407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.509109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.509490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.509859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.593987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:22.597840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.600100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:22.740019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 573/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:22.747048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.893277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136085b-c4be-40e9-b2ad-83ab0ff9ab46 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.948984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836486e-19d6-4961-91e2-4d322e4d4823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.949900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836486e-19d6-4961-91e2-4d322e4d4823 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.950635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836486e-19d6-4961-91e2-4d322e4d4823 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.951462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836486e-19d6-4961-91e2-4d322e4d4823 None admin] PATH_INFO: `/v3/projects/be364e11e84b479c94f418acb2c4cf6d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.954087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836486e-19d6-4961-91e2-4d322e4d4823 None admin] RBAC: Authorizing `identity:get_project(project_id=be364e11e84b479c94f418acb2c4cf6d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.958351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836486e-19d6-4961-91e2-4d322e4d4823 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:22.960568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 587/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/projects/be364e11e84b479c94f418acb2c4cf6d => generated 311 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:22.971679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:23.178653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:23.184169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026c63-0adc-4f1b-a4ee-1a3b1d25e3b7 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:23.264152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664786b-2ac5-4a09-9352-9b2b7fc6aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:23.265229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664786b-2ac5-4a09-9352-9b2b7fc6aa74 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:23.265718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664786b-2ac5-4a09-9352-9b2b7fc6aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:23.266202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664786b-2ac5-4a09-9352-9b2b7fc6aa74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:23.268198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664786b-2ac5-4a09-9352-9b2b7fc6aa74 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=be364e11e84b479c94f418acb2c4cf6d, user.id=354b7fec663144a4a7a667c3b1449a38) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:23.268780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664786b-2ac5-4a09-9352-9b2b7fc6aa74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:23.271579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664786b-2ac5-4a09-9352-9b2b7fc6aa74 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:23.283570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 574/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/role_assignments?user.id=354b7fec663144a4a7a667c3b1449a38&scope.project.id=be364e11e84b479c94f418acb2c4cf6d&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:25.548255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24fa42-f346-4490-b318-3ff9bb25b876 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.549638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24fa42-f346-4490-b318-3ff9bb25b876 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.549638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24fa42-f346-4490-b318-3ff9bb25b876 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.550766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 588/1162] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:25.558017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c0830-c8fc-49f0-a1a9-646470bdd87c None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.558840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c0830-c8fc-49f0-a1a9-646470bdd87c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.559004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c0830-c8fc-49f0-a1a9-646470bdd87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.590125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b93c0830-c8fc-49f0-a1a9-646470bdd87c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:25.591978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b93c0830-c8fc-49f0-a1a9-646470bdd87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:25.698362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 575/1163] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:26.025661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24fa42-f346-4490-b318-3ff9bb25b876 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:26.073119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:26.191447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24fa42-f346-4490-b318-3ff9bb25b876 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:26.243824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:26.244647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:26.245047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:26.245468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:26.384409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:26.387598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:26.429070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:26.560490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 589/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:03:26.572253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c0830-c8fc-49f0-a1a9-646470bdd87c None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:26.729488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:26.741200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c0830-c8fc-49f0-a1a9-646470bdd87c None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:26.788888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6590c7-3560-4c4c-9d43-bd1bf60015ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:26.789587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6590c7-3560-4c4c-9d43-bd1bf60015ec None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:26.789925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6590c7-3560-4c4c-9d43-bd1bf60015ec None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:26.790299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6590c7-3560-4c4c-9d43-bd1bf60015ec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:26.798971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6590c7-3560-4c4c-9d43-bd1bf60015ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:26.800792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6590c7-3560-4c4c-9d43-bd1bf60015ec None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9f6590c7-3560-4c4c-9d43-bd1bf60015ec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:26.816131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:26.818019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:03:26.819907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 576/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:03:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:26.825928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:26.996161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337aa7f-718e-496d-b1f1-e938fe897a2d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:27.038049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:27.051677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa167aa9-4808-4898-b211-7756f596c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:27.052371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167aa9-4808-4898-b211-7756f596c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:27.057485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167aa9-4808-4898-b211-7756f596c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:27.057485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167aa9-4808-4898-b211-7756f596c8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:27.057485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167aa9-4808-4898-b211-7756f596c8d5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:27.057485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167aa9-4808-4898-b211-7756f596c8d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:27.057485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167aa9-4808-4898-b211-7756f596c8d5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:27.065297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 590/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Fri Sep 2 21:03:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:29.468571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826742d7-8a78-4ee9-be62-ae9b7d039703 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:29.469193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826742d7-8a78-4ee9-be62-ae9b7d039703 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:29.469590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826742d7-8a78-4ee9-be62-ae9b7d039703 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:29.474361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 577/1167] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:29.481878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3561c-6938-4f90-8b3d-45fd850de14f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:29.482652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3561c-6938-4f90-8b3d-45fd850de14f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:29.482652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3561c-6938-4f90-8b3d-45fd850de14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:29.512330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-38e3561c-6938-4f90-8b3d-45fd850de14f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:29.513620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-38e3561c-6938-4f90-8b3d-45fd850de14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:29.622130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 591/1168] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:29.997735 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826742d7-8a78-4ee9-be62-ae9b7d039703 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:30.219330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826742d7-8a78-4ee9-be62-ae9b7d039703 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:30.287019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cd949-84df-480f-904a-d660712e85c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:30.287659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cd949-84df-480f-904a-d660712e85c4 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:30.287988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cd949-84df-480f-904a-d660712e85c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:30.288319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cd949-84df-480f-904a-d660712e85c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:30.289124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cd949-84df-480f-904a-d660712e85c4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:30.290622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cd949-84df-480f-904a-d660712e85c4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:30.407793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 578/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Fri Sep 2 21:03:29 2022] POST /identity/v3/domains => generated 267 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:33.029508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c5b10-119a-4402-bbfb-84815f2374d0 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:33.030096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c5b10-119a-4402-bbfb-84815f2374d0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:33.030352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c5b10-119a-4402-bbfb-84815f2374d0 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:33.033614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 592/1170] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:33.041539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be110-11e9-4b7e-97f1-054ea17ec627 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:33.042404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be110-11e9-4b7e-97f1-054ea17ec627 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:33.042588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be110-11e9-4b7e-97f1-054ea17ec627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:33.075077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f81be110-11e9-4b7e-97f1-054ea17ec627 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:33.077351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f81be110-11e9-4b7e-97f1-054ea17ec627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:33.098690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:33.213275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 579/1171] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:33.531062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c5b10-119a-4402-bbfb-84815f2374d0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:33.715573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c5b10-119a-4402-bbfb-84815f2374d0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:33.750864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:33.782801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25ea88-00cc-4328-a6b9-499bc3725eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:33.783717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25ea88-00cc-4328-a6b9-499bc3725eb1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:33.784186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25ea88-00cc-4328-a6b9-499bc3725eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:33.784525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25ea88-00cc-4328-a6b9-499bc3725eb1 None admin] PATH_INFO: `/v3/domains/cb18bf598bcf4111a95dbfd295f89f94` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:33.816600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25ea88-00cc-4328-a6b9-499bc3725eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cb18bf598bcf4111a95dbfd295f89f94)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:33.819409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25ea88-00cc-4328-a6b9-499bc3725eb1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:33.822604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 593/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Fri Sep 2 21:03:33 2022] GET /identity/v3/domains/cb18bf598bcf4111a95dbfd295f89f94 => generated 267 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:33.832798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81be110-11e9-4b7e-97f1-054ea17ec627 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:34.029364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81be110-11e9-4b7e-97f1-054ea17ec627 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:34.097981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92627cf0-ce85-469f-bfaf-2b4a334c6c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:34.098994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92627cf0-ce85-469f-bfaf-2b4a334c6c27 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:34.099349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92627cf0-ce85-469f-bfaf-2b4a334c6c27 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:34.099748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92627cf0-ce85-469f-bfaf-2b4a334c6c27 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:34.100995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92627cf0-ce85-469f-bfaf-2b4a334c6c27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:34.103513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92627cf0-ce85-469f-bfaf-2b4a334c6c27 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:34.134363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:34.262533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 580/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:03:33 2022] POST /identity/v3/projects => generated 361 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:37.121316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d550-9e80-4265-9f6d-6a6c5dc6df5d None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:37.122098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d550-9e80-4265-9f6d-6a6c5dc6df5d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:37.122098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d550-9e80-4265-9f6d-6a6c5dc6df5d None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:37.123674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 594/1174] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:37.134016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b46d-66f3-4271-a355-c669c5cc53b0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:37.137488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b46d-66f3-4271-a355-c669c5cc53b0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:37.137488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b46d-66f3-4271-a355-c669c5cc53b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:37.159122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9cf8b46d-66f3-4271-a355-c669c5cc53b0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:37.160806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9cf8b46d-66f3-4271-a355-c669c5cc53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:37.268057 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 581/1175] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:37.614206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d550-9e80-4265-9f6d-6a6c5dc6df5d None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:37.785276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d550-9e80-4265-9f6d-6a6c5dc6df5d None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:37.838578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f20db-bd5e-4bae-8078-31c995f91593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:37.839261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f20db-bd5e-4bae-8078-31c995f91593 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:37.839545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f20db-bd5e-4bae-8078-31c995f91593 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:37.839884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f20db-bd5e-4bae-8078-31c995f91593 None admin] PATH_INFO: `/v3/domains/cb18bf598bcf4111a95dbfd295f89f94` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:37.841514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f20db-bd5e-4bae-8078-31c995f91593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cb18bf598bcf4111a95dbfd295f89f94)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:37.843179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f20db-bd5e-4bae-8078-31c995f91593 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:37.845779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 595/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Fri Sep 2 21:03:37 2022] GET /identity/v3/domains/cb18bf598bcf4111a95dbfd295f89f94 => generated 267 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:37.854905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b46d-66f3-4271-a355-c669c5cc53b0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:38.014159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b46d-66f3-4271-a355-c669c5cc53b0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:38.059306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:38.077670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cb00d-c272-478c-9d02-4a894dcb234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:38.078620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb00d-c272-478c-9d02-4a894dcb234b None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:38.079366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb00d-c272-478c-9d02-4a894dcb234b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:38.079760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb00d-c272-478c-9d02-4a894dcb234b None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:38.081195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cb00d-c272-478c-9d02-4a894dcb234b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:38.083437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cb00d-c272-478c-9d02-4a894dcb234b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:38.265936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 582/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:03:37 2022] POST /identity/v3/users => generated 311 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:40.882971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca516ab-7ce2-4aa1-a324-6afaa4e83284 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:40.883653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca516ab-7ce2-4aa1-a324-6afaa4e83284 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:40.883653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca516ab-7ce2-4aa1-a324-6afaa4e83284 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:40.884885 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 596/1178] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:40.895291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7713a-d919-43d5-96fe-443d7b4a80b6 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:40.896168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7713a-d919-43d5-96fe-443d7b4a80b6 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:40.896326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7713a-d919-43d5-96fe-443d7b4a80b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:40.921104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6dc7713a-d919-43d5-96fe-443d7b4a80b6 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:40.922355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6dc7713a-d919-43d5-96fe-443d7b4a80b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:41.035964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 583/1179] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:41.366993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca516ab-7ce2-4aa1-a324-6afaa4e83284 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:41.466250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:41.569368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca516ab-7ce2-4aa1-a324-6afaa4e83284 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:41.641286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:41.642882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:41.643399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:41.643868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:41.665987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:41.675698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:41.677068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:03:41.678422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 597/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:41.690370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7713a-d919-43d5-96fe-443d7b4a80b6 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:41.840126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7713a-d919-43d5-96fe-443d7b4a80b6 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:41.863810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:41.919878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:41.919878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:41.919878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:41.919878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:41.921355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:41.921355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:41.921355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:41.921355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 584/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:41.921935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:42.098651 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5706356-bec8-4645-9827-aecda23a25f5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:42.101933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:42.161157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:42.161879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:42.162476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:42.162975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] PATH_INFO: `/v3/users/03bba92ea5e0409fad686e8e02092f3f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:42.188843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=03bba92ea5e0409fad686e8e02092f3f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:42.191365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:42.193633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 598/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:41 2022] GET /identity/v3/users/03bba92ea5e0409fad686e8e02092f3f => generated 311 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:42.202033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:42.354812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e5cd1-f152-4923-a532-5907bf5e39d4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:42.402723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:42.403601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:42.403893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:42.404174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:42.460005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:42.491846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:42.497553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:42.648362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 585/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:42.657732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:42.823405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0255a3e-420d-48dd-8c00-534b70c1e8e8 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:42.882692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93501617-0a63-41cf-a9fb-c42a2bd1e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:42.883786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501617-0a63-41cf-a9fb-c42a2bd1e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:42.884279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501617-0a63-41cf-a9fb-c42a2bd1e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:42.884773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501617-0a63-41cf-a9fb-c42a2bd1e8f3 None admin] PATH_INFO: `/v3/projects/d6e66e17800a41cbb084e19ef8c673b6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:42.887051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93501617-0a63-41cf-a9fb-c42a2bd1e8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e66e17800a41cbb084e19ef8c673b6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:42.889828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93501617-0a63-41cf-a9fb-c42a2bd1e8f3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:42.893142 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 599/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:42 2022] GET /identity/v3/projects/d6e66e17800a41cbb084e19ef8c673b6 => generated 361 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:42.903734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:43.017456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:43.051589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c00f-fb1f-40fe-8793-c4a4b35005f0 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:43.094951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50301e4f-abb9-4e8b-b38f-053e5d310ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:43.095796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301e4f-abb9-4e8b-b38f-053e5d310ccf None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:43.096183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301e4f-abb9-4e8b-b38f-053e5d310ccf None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:43.096578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301e4f-abb9-4e8b-b38f-053e5d310ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:43.097591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301e4f-abb9-4e8b-b38f-053e5d310ccf None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=d6e66e17800a41cbb084e19ef8c673b6, user.id=03bba92ea5e0409fad686e8e02092f3f) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:43.098004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301e4f-abb9-4e8b-b38f-053e5d310ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:43.099602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301e4f-abb9-4e8b-b38f-053e5d310ccf None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:43.106512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 586/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:42 2022] GET /identity/v3/role_assignments?user.id=03bba92ea5e0409fad686e8e02092f3f&scope.project.id=d6e66e17800a41cbb084e19ef8c673b6&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:45.429086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e4faa-c669-4945-b58a-927bd0f57b48 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:45.429673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e4faa-c669-4945-b58a-927bd0f57b48 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:45.429673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e4faa-c669-4945-b58a-927bd0f57b48 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:45.431154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 600/1186] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:45.439502 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d51d4-023b-4cc5-b4b5-b02e267785a9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:45.440106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d51d4-023b-4cc5-b4b5-b02e267785a9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:45.440106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d51d4-023b-4cc5-b4b5-b02e267785a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:45.460006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0b2d51d4-023b-4cc5-b4b5-b02e267785a9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:45.461269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0b2d51d4-023b-4cc5-b4b5-b02e267785a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:45.549831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 587/1187] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:45.913811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e4faa-c669-4945-b58a-927bd0f57b48 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:45.957130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:46.073539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e4faa-c669-4945-b58a-927bd0f57b48 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:46.119532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:46.120251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.120586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.120995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.143442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:46.152892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:46.155014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:03:46.156789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 601/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:46.167759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d51d4-023b-4cc5-b4b5-b02e267785a9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:46.279829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:46.339046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d51d4-023b-4cc5-b4b5-b02e267785a9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:46.390372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:46.391668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.391926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.392305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.393105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:46.393450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:46.395034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:46.408331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 588/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:46.416089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:46.582924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:46.599976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc955a3-c392-4361-843a-78ef34d018fa None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:46.651505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:46.652157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.652435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.652946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] PATH_INFO: `/v3/users/03bba92ea5e0409fad686e8e02092f3f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.654181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] RBAC: Authorizing `identity:get_user(user_id=03bba92ea5e0409fad686e8e02092f3f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:46.656192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:46.660702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 602/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:46 2022] GET /identity/v3/users/03bba92ea5e0409fad686e8e02092f3f => generated 311 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:46.668717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:46.824212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28494d2-8ea4-4dde-8ca0-1ae8df0d5514 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:46.892453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:46.900690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f74aa-62e7-448d-aea8-5970ca303e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:46.907724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f74aa-62e7-448d-aea8-5970ca303e1f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.907724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f74aa-62e7-448d-aea8-5970ca303e1f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.907724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f74aa-62e7-448d-aea8-5970ca303e1f None admin] PATH_INFO: `/v3/projects/d6e66e17800a41cbb084e19ef8c673b6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.907724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f74aa-62e7-448d-aea8-5970ca303e1f None admin] RBAC: Authorizing `identity:get_project(project_id=d6e66e17800a41cbb084e19ef8c673b6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:46.907724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f74aa-62e7-448d-aea8-5970ca303e1f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:46.908695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 589/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:46 2022] GET /identity/v3/projects/d6e66e17800a41cbb084e19ef8c673b6 => generated 361 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:46.915415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:47.086458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0c2e-5c0f-47b7-8e45-8a5c1b8e70b4 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:47.144059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2ba8f-0fe5-45b2-8bb4-8d9d2372eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:47.144841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2ba8f-0fe5-45b2-8bb4-8d9d2372eebe None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:47.145361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2ba8f-0fe5-45b2-8bb4-8d9d2372eebe None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:47.145746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2ba8f-0fe5-45b2-8bb4-8d9d2372eebe None admin] PATH_INFO: `/v3/projects/d6e66e17800a41cbb084e19ef8c673b6/users/03bba92ea5e0409fad686e8e02092f3f/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:47.157382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2ba8f-0fe5-45b2-8bb4-8d9d2372eebe None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e66e17800a41cbb084e19ef8c673b6, user_id=03bba92ea5e0409fad686e8e02092f3f, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:47.160352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2ba8f-0fe5-45b2-8bb4-8d9d2372eebe None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:47.395070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 603/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:03:46 2022] PUT /identity/v3/projects/d6e66e17800a41cbb084e19ef8c673b6/users/03bba92ea5e0409fad686e8e02092f3f/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:03:49.981372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfe4d0-c8d7-4c9f-8034-b9f385db2730 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:49.981947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfe4d0-c8d7-4c9f-8034-b9f385db2730 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:49.982232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfe4d0-c8d7-4c9f-8034-b9f385db2730 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:49.984759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 590/1193] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:49.993955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8565-aa12-46a7-a474-f8f610b8a729 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:49.994805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8565-aa12-46a7-a474-f8f610b8a729 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:49.994970 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8565-aa12-46a7-a474-f8f610b8a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:50.017068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-89ad8565-aa12-46a7-a474-f8f610b8a729 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:50.018458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-89ad8565-aa12-46a7-a474-f8f610b8a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:50.037280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:50.141452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 604/1194] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:50.507328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfe4d0-c8d7-4c9f-8034-b9f385db2730 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:50.695411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfe4d0-c8d7-4c9f-8034-b9f385db2730 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:50.760355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:50.760954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:50.761232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:50.761620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:50.783644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:50.788635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:50.789994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:03:50.791095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 591/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:50.801469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8565-aa12-46a7-a474-f8f610b8a729 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:50.980066 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8565-aa12-46a7-a474-f8f610b8a729 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:51.031151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:51.032331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:51.032331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:51.032856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:51.034046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:51.034555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:51.037200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:51.051542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 605/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:51.060394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:51.170308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:51.241624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598154e-1cfd-4327-aa97-535c1812e775 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:51.291017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:51.291974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:51.292426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:51.292920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] PATH_INFO: `/v3/users/03bba92ea5e0409fad686e8e02092f3f` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:51.296428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] RBAC: Authorizing `identity:get_user(user_id=03bba92ea5e0409fad686e8e02092f3f)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:51.299308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:51.302913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 592/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:51 2022] GET /identity/v3/users/03bba92ea5e0409fad686e8e02092f3f => generated 311 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:51.311683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:51.336538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:51.488534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711832c2-89fc-4ee6-9fd8-3bac84732f5f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:51.530772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:51.532292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:51.532630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:51.533003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:51.622495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:51.624209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:51.643067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:51.760433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 606/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:51.768304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:51.942754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dfb00-1627-40b8-940b-58125a4509ea None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:52.003496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:52.020986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a297c8c-af92-4313-9a2b-a361de70183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:52.025323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297c8c-af92-4313-9a2b-a361de70183e None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:52.025323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297c8c-af92-4313-9a2b-a361de70183e None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:52.025323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297c8c-af92-4313-9a2b-a361de70183e None admin] PATH_INFO: `/v3/projects/d6e66e17800a41cbb084e19ef8c673b6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:52.025323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a297c8c-af92-4313-9a2b-a361de70183e None admin] RBAC: Authorizing `identity:get_project(project_id=d6e66e17800a41cbb084e19ef8c673b6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:52.027911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a297c8c-af92-4313-9a2b-a361de70183e None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:52.031098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 593/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:51 2022] GET /identity/v3/projects/d6e66e17800a41cbb084e19ef8c673b6 => generated 361 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:52.038699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:52.207394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca8e5-08f1-4389-bb55-3a9d5e2326de None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:52.223981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:52.266805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13083-ce40-44fc-8dc5-a1c26aa2715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:52.267754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13083-ce40-44fc-8dc5-a1c26aa2715e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:52.268204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13083-ce40-44fc-8dc5-a1c26aa2715e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:52.268900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13083-ce40-44fc-8dc5-a1c26aa2715e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:52.270258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13083-ce40-44fc-8dc5-a1c26aa2715e None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=d6e66e17800a41cbb084e19ef8c673b6, user.id=03bba92ea5e0409fad686e8e02092f3f) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:52.270550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13083-ce40-44fc-8dc5-a1c26aa2715e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:52.273165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13083-ce40-44fc-8dc5-a1c26aa2715e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:52.285682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 607/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:52 2022] GET /identity/v3/role_assignments?user.id=03bba92ea5e0409fad686e8e02092f3f&scope.project.id=d6e66e17800a41cbb084e19ef8c673b6&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:02.111835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:02.279030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=13 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:30.540899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342194af-7d0e-4533-894c-fd80432d0a63 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:30.541850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342194af-7d0e-4533-894c-fd80432d0a63 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:30.541850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342194af-7d0e-4533-894c-fd80432d0a63 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:30.546857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 594/1201] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:05:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:30.555791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bdb86-54d4-453c-99ad-63bd7baf01d0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:30.556652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bdb86-54d4-453c-99ad-63bd7baf01d0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:30.556652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bdb86-54d4-453c-99ad-63bd7baf01d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:30.596508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-db7bdb86-54d4-453c-99ad-63bd7baf01d0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:30.596508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-db7bdb86-54d4-453c-99ad-63bd7baf01d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:30.736928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 608/1202] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:31.059816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342194af-7d0e-4533-894c-fd80432d0a63 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:31.265764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342194af-7d0e-4533-894c-fd80432d0a63 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:31.333712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:31.334672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:31.335109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:31.335529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:31.357977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:31.360779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:31.390457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:31.391876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:31.393140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:31.393140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:31.393140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:31.393140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 595/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:31.402064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bdb86-54d4-453c-99ad-63bd7baf01d0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:31.585620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bdb86-54d4-453c-99ad-63bd7baf01d0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:31.631169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:31.639540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6736d54-2228-489d-84aa-223c393d1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:31.640298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6736d54-2228-489d-84aa-223c393d1b33 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:31.640707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6736d54-2228-489d-84aa-223c393d1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:31.641011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6736d54-2228-489d-84aa-223c393d1b33 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:31.641757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6736d54-2228-489d-84aa-223c393d1b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:31.642103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6736d54-2228-489d-84aa-223c393d1b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:31.643515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6736d54-2228-489d-84aa-223c393d1b33 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:31.661098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 609/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:31.667573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:31.753606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:31.833100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba204e83-6861-4a6d-ae50-fd07f1d3295a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:31.906127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ab5e-025f-402d-82e9-6b4b96bad09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:31.907091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ab5e-025f-402d-82e9-6b4b96bad09c None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:31.907693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ab5e-025f-402d-82e9-6b4b96bad09c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:31.908139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ab5e-025f-402d-82e9-6b4b96bad09c None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:31.909449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ab5e-025f-402d-82e9-6b4b96bad09c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:31.916135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ab5e-025f-402d-82e9-6b4b96bad09c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:32.048083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 596/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Fri Sep 2 21:05:31 2022] POST /identity/v3/users => generated 251 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:05:34.870507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee811e5-9b8d-45a5-ae00-2b4045964cf2 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:34.871202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee811e5-9b8d-45a5-ae00-2b4045964cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:34.872322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee811e5-9b8d-45a5-ae00-2b4045964cf2 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:34.875210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 610/1206] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:05:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:34.885279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165705f-5c13-4ac1-8236-81f74b329b6d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:34.886123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165705f-5c13-4ac1-8236-81f74b329b6d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:34.886288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165705f-5c13-4ac1-8236-81f74b329b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:34.921258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2165705f-5c13-4ac1-8236-81f74b329b6d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:34.923432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2165705f-5c13-4ac1-8236-81f74b329b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:35.047162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 597/1207] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:35.571631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee811e5-9b8d-45a5-ae00-2b4045964cf2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:35.794967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee811e5-9b8d-45a5-ae00-2b4045964cf2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:35.867592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:35.868794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:35.869287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:35.869764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:35.892982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:35.899776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:35.915326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:35.917341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 611/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:35.920415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165705f-5c13-4ac1-8236-81f74b329b6d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:35.992946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:36.092959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165705f-5c13-4ac1-8236-81f74b329b6d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:36.150214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:36.151053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:36.151494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:36.151932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:36.153777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:36.154273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:36.156685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:36.172889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 598/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:05:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:05:36.180634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:36.295219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:36.403773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1489-f825-4a92-b0b5-1970a4331010 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:36.464268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:36.466607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:36.468318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:36.468318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:36.490470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:36.493086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:36.514513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:36.520481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:36.522425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:36.522425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:36.522425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:36.522425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 612/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:36.523240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:36.720378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:36.729024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc76b9-7da3-4c9a-a173-7d8836b3b35b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:36.782177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:36.782946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:36.783307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:36.783676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:36.787656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:36.788091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:36.789699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:36.820845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 599/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:36.828765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:37.007561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c874a4-0949-4ab9-a671-b98c317ba70f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:37.010667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:37.069940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:37.071046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:37.071532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:37.072016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] PATH_INFO: `/v3/users/placement` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:37.086409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:37.088183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:37.105501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:37.107588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:37.109753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 613/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:37.118019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:37.280672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906300-be43-4215-ad7d-8392a13aff88 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:37.337677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:37.338351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:37.338686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:37.339012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:37.340486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:37.341104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:37.342700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:37.373032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 600/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:37.382199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:37.534518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9997b73-105a-47a3-accf-3b31d3afa89e None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:37.582717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:37.583281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:37.584083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:37.584083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:37.627689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:37.682777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:37.685047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:37.841962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 614/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:05:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:05:37.848442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:37.878551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.013423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878794b-f672-463a-9abc-31b754ccc64d None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.072527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.073465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.074385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.074385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.087334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.089054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:38.110175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:38.111840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:38.113269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:38.113269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:38.113269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:38.113269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 601/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:38.123472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.245732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.305662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a659ffb-3a24-4cda-84d9-71402d0b6e95 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.360468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.361145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.361477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.361801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.362569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:38.362931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.364502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.388252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 615/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:05:38.397252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.528353 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.596894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d052e2-6cbc-4e95-a647-321a961f5c55 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.661533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.662323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.662674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.663000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.673376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.675245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:38.690775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:38.692652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:38.694505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 602/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:38.703678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.882533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7b9c7-ec0f-44c8-9124-671081a5b4a1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.915363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.931588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3f10-6808-477c-b8c7-18f9876a4f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.933050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3f10-6808-477c-b8c7-18f9876a4f73 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.933050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3f10-6808-477c-b8c7-18f9876a4f73 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.933050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3f10-6808-477c-b8c7-18f9876a4f73 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.934441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba3f10-6808-477c-b8c7-18f9876a4f73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:38.934809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba3f10-6808-477c-b8c7-18f9876a4f73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.936477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba3f10-6808-477c-b8c7-18f9876a4f73 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.956872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 616/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:38.966093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:39.133567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d93bf-fd3e-4f0e-9d1c-c1fd1cabc0a5 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:39.190668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:39.200138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034889-8ff9-4d65-8ed8-b0b1622e63bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:39.201517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034889-8ff9-4d65-8ed8-b0b1622e63bf None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:39.201991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034889-8ff9-4d65-8ed8-b0b1622e63bf None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:39.202530 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034889-8ff9-4d65-8ed8-b0b1622e63bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:39.203325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86034889-8ff9-4d65-8ed8-b0b1622e63bf None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a3f84705571649b2bc20ec777e1e6a31) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:39.203646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86034889-8ff9-4d65-8ed8-b0b1622e63bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:39.205369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86034889-8ff9-4d65-8ed8-b0b1622e63bf None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:39.212312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 603/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/role_assignments?user.id=a3f84705571649b2bc20ec777e1e6a31&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:41.622297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fbcf2-d49c-4ef4-bfab-bfebff407e4d None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:41.623131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fbcf2-d49c-4ef4-bfab-bfebff407e4d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:41.623131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fbcf2-d49c-4ef4-bfab-bfebff407e4d None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:41.624466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 617/1220] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:41.631113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d7ce-f8f7-4245-b069-a6c8e7e98b92 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:41.632456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d7ce-f8f7-4245-b069-a6c8e7e98b92 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:41.632456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d7ce-f8f7-4245-b069-a6c8e7e98b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:41.654314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6584d7ce-f8f7-4245-b069-a6c8e7e98b92 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:41.655601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6584d7ce-f8f7-4245-b069-a6c8e7e98b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:41.757638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 604/1221] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:42.048384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fbcf2-d49c-4ef4-bfab-bfebff407e4d None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:42.187977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fbcf2-d49c-4ef4-bfab-bfebff407e4d None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:42.230610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:42.231252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.231513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.231788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.243956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:42.252895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:42.254072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:42.255199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 618/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:42.265308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d7ce-f8f7-4245-b069-a6c8e7e98b92 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:42.437139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d7ce-f8f7-4245-b069-a6c8e7e98b92 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:42.472049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:42.485799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:42.486465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.486802 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.487117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.487894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] RBAC: Adding query filter params (name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:42.488249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:42.489766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:42.504097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 605/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:42.512121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:42.570713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:42.668175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906c3db-a06c-482f-b364-63debd633787 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:42.725301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:42.727646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.728483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.733487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.752860 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:42.755004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:42.775799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:42.777291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:42.779338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:42.779338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:42.779338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:42.779338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 619/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:42.784124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:42.918918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32cef3-c981-4c06-9621-5c984320322f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:42.966425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:42.967112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.967391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.967659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.968307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:42.968605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:42.970050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:42.990555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 606/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:42.992517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.139756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:43.148219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674871b-5d27-4c9a-8d4e-4b7cd745df29 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.190773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.192613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.192613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.192613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.201463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.203003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:43.217184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:43.218437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:43.219832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 620/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:43.224637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.293994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:43.380871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179e39-704e-4325-8881-b1927b8854f3 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.434689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.439185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.439185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.439185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.439185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:43.439185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.441352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.473988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 607/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:43.481174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.633034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424991b-28f8-4aee-ae8c-c34a54b607b5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.679604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.680849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.681247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.681625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.702447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.705276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:43.737326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:43.739277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:43.740454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:43.740454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:43.740454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:43.740454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 621/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:43.750760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.910688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339106-37b9-4dc2-a873-2a459f014cb6 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.913690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:43.965027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.978532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.978532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.978532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.978532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:43.978532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.978532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.992456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 608/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:44.001526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:44.017365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:44.174209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ca9d-6f28-4cef-ad87-ee15b272350c None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:44.232049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:44.233034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:44.233419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:44.233728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:44.244997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:44.247810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:44.270163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:44.281296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:44.283385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 622/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:44.284555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:44.483457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00568-80fd-4942-9a34-0e6b21d499fa None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:44.526290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e384bd-ea7d-4247-8011-2cb7b56e3ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:44.526916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e384bd-ea7d-4247-8011-2cb7b56e3ad2 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:44.527251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e384bd-ea7d-4247-8011-2cb7b56e3ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:44.528305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e384bd-ea7d-4247-8011-2cb7b56e3ad2 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:44.529058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e384bd-ea7d-4247-8011-2cb7b56e3ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:44.529368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e384bd-ea7d-4247-8011-2cb7b56e3ad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:44.530838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e384bd-ea7d-4247-8011-2cb7b56e3ad2 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:44.545780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 609/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:44.553483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:44.654558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:44.704876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0b80f-686f-4e95-b4b6-4edbbfa189d1 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:44.752121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcbbac-3a92-4eac-b525-4ce35651b9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:44.752711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbbac-3a92-4eac-b525-4ce35651b9bd None admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:44.753023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbbac-3a92-4eac-b525-4ce35651b9bd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:44.753306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbbac-3a92-4eac-b525-4ce35651b9bd None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a3f84705571649b2bc20ec777e1e6a31/roles/a71fb39654574349b08964577c193469` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:44.782584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcbbac-3a92-4eac-b525-4ce35651b9bd None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=a3f84705571649b2bc20ec777e1e6a31, role_id=a71fb39654574349b08964577c193469)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:44.784776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcbbac-3a92-4eac-b525-4ce35651b9bd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:44.945735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 623/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:05:44 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a3f84705571649b2bc20ec777e1e6a31/roles/a71fb39654574349b08964577c193469 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:05:47.290335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ce79-eee9-43ba-98d6-8a10859f4b4e None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:47.291149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ce79-eee9-43ba-98d6-8a10859f4b4e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:47.291325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ce79-eee9-43ba-98d6-8a10859f4b4e None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:47.293911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 610/1233] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:05:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:47.300212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9301eb-ff1b-4eb1-b67b-99a98ecb49d3 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:47.301584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9301eb-ff1b-4eb1-b67b-99a98ecb49d3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:47.301584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9301eb-ff1b-4eb1-b67b-99a98ecb49d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:47.326594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-ed9301eb-ff1b-4eb1-b67b-99a98ecb49d3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:47.328295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ed9301eb-ff1b-4eb1-b67b-99a98ecb49d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:47.413743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 624/1234] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:05:47.790239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ce79-eee9-43ba-98d6-8a10859f4b4e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:47.826780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:47.941399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ce79-eee9-43ba-98d6-8a10859f4b4e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.003765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.004360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.004703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.005085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.022297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:48.032656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:48.036598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:48.038345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 611/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Fri Sep 2 21:05:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:48.043841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9301eb-ff1b-4eb1-b67b-99a98ecb49d3 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.100428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:48.171232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9301eb-ff1b-4eb1-b67b-99a98ecb49d3 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.215542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.216260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.216545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.216850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.217549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] RBAC: Adding query filter params (name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:48.217900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.219306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.228873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 625/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:48.234876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.357455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:48.388402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74192ad-0bd8-4edb-a0d1-c0c2e5965c40 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.474174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.475272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.475776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.476318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.498886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.501701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:48.529102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:48.531022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:48.532887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:48.532887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:48.532887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:48.532887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 612/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:48.537383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.675621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431f262-0fb4-42d7-9af9-b2b11c2994fe None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.692112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:48.735371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.736297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.736641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.737257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.738340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:48.738837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.741185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.762847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 626/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:48.769446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.907826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77e22c-0e34-4605-9f2c-fa47fb0ac6e4 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.976670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.977730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.978192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.978639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.983653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:48.990911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.993117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:49.006926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:49.008819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:49.010718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 613/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:49.016027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:49.157172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2f993-c6d9-4963-8114-e35fe45a7b67 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:49.200227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:49.200901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:49.201179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:49.201509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:49.202299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:49.202600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:49.204124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:49.231711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 627/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:49.238116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:49.384466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cf600-7b45-4724-9e00-9d7fc8f1e121 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:49.451418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:49.452319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:49.452642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:49.453251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:49.557247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:49.565533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:49.567050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:49.736946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 614/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:05:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:05:49.747227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:49.785241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:49.902149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbcd6d-588b-4fae-a305-c710d9da1b1f None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:49.952459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:49.953587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:49.954081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:49.954578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:49.976112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:49.981273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:50.003266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:50.005232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:50.007502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:50.007502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:50.007502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:50.007502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 628/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:50.013926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:50.183102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:50.200948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f06951-7ccb-4dac-8f09-91e5d0aecf6f None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:50.249142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:50.250153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:50.250639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:50.251107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:50.251879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:50.252341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:50.254573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:50.282095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 615/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:50.290037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:50.411756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:50.443664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078b133-4756-40a1-a07e-0155a89c63b8 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:50.502448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:50.503342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:50.503749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:50.504149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:50.516412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:50.517962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:50.531980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:50.533816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:50.535786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 629/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:50.541078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:50.669114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51db51-4bd0-4429-96c8-fcbbdc88724a None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:50.727431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c79ac3-a6f8-49c6-8ef7-47cbc3cf5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:50.728320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c79ac3-a6f8-49c6-8ef7-47cbc3cf5223 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:50.731294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c79ac3-a6f8-49c6-8ef7-47cbc3cf5223 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:50.731294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c79ac3-a6f8-49c6-8ef7-47cbc3cf5223 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:50.731294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c79ac3-a6f8-49c6-8ef7-47cbc3cf5223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:50.731904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c79ac3-a6f8-49c6-8ef7-47cbc3cf5223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:50.733473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c79ac3-a6f8-49c6-8ef7-47cbc3cf5223 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:50.750296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 616/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:50.757715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:50.901210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac2394-4a7f-4c30-8314-83c4896f66b6 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:50.945021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3dbf-8c88-4729-84cb-acd01d1788e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:50.945725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3dbf-8c88-4729-84cb-acd01d1788e0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:50.946070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3dbf-8c88-4729-84cb-acd01d1788e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:50.946448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3dbf-8c88-4729-84cb-acd01d1788e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:50.947271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3dbf-8c88-4729-84cb-acd01d1788e0 None admin] RBAC: Adding query filter params (role.id=a71fb39654574349b08964577c193469, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a3f84705571649b2bc20ec777e1e6a31) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:50.947653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3dbf-8c88-4729-84cb-acd01d1788e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:50.949864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3dbf-8c88-4729-84cb-acd01d1788e0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:50.956888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 630/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:05:50 2022] GET /identity/v3/role_assignments?user.id=a3f84705571649b2bc20ec777e1e6a31&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=a71fb39654574349b08964577c193469 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:53.337598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8110d6-e827-4b19-8b14-dc53bbeb9e0d None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:53.338422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8110d6-e827-4b19-8b14-dc53bbeb9e0d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:53.338615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8110d6-e827-4b19-8b14-dc53bbeb9e0d None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:53.341093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 617/1247] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:05:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:05:53.347543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbfe34-ee73-4fca-b3bd-e1962ebf30a5 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:53.348293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbfe34-ee73-4fca-b3bd-e1962ebf30a5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:53.348424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbfe34-ee73-4fca-b3bd-e1962ebf30a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:53.359406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:53.381328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-75fbfe34-ee73-4fca-b3bd-e1962ebf30a5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:53.388524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-75fbfe34-ee73-4fca-b3bd-e1962ebf30a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:53.512765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 631/1248] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:05:53.797824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8110d6-e827-4b19-8b14-dc53bbeb9e0d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:53.819872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:53.960958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8110d6-e827-4b19-8b14-dc53bbeb9e0d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:54.027088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:54.028092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:54.028535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:54.029032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:54.050031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:54.060763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:54.062682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:54.064292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 618/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:05:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:54.071669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbfe34-ee73-4fca-b3bd-e1962ebf30a5 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:54.237682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbfe34-ee73-4fca-b3bd-e1962ebf30a5 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:54.287307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:54.294507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:54.296927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:54.296927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:54.297594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:54.299429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:54.300014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:54.301871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:54.312844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 632/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:05:54.319071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:54.447313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:54.478591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c7ef-f6af-41d8-a7eb-c1358ecdf66c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:54.546812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:54.547992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:54.548680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:54.549214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:54.563464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:54.565227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:54.594152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:54.596301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:54.598242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:54.598242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:54.598242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:54.598242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 619/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:54.604285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:54.786743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7178a2-99ac-4ac5-a73d-9b13460bd08a None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:54.841846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:54.842795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:54.843297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:54.843767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:54.845192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:54.850053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:54.850053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:54.872355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 633/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:54.879147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:55.065612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeed01-969a-4a0b-835b-a3284c14ba34 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:55.101080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:55.110185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:55.111166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:55.111562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:55.111879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:55.122734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:55.124307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:55.143579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:55.145382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:05:55.147130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 620/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:55.153785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:55.251110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:55.330979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1def5e-fff9-4db0-ab99-036ab6df6ca7 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:55.374634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:55.375585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:55.376073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:55.376531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:55.377936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:55.378473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:55.381257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:55.412096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 634/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:05:55.419637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:55.571765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd066a-98fd-4eed-84c8-f7f7acdc76dc None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:55.617324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:55.618010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:55.618564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:55.619097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:55.710310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:55.734992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:55.736499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:55.886147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 621/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:05:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:05:55.896941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.056986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4fbf-6aa5-41e0-942d-a4ee0ff81f16 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.077658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:56.114821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.115896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.116408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.116905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.138910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.141867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:56.171520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:56.173386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:56.174895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:56.174895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:56.174895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:56.174895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 635/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:56.183863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.357900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:56.379082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ae742-cbd1-4692-96dc-cc2b00195dc9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.445188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.446126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.446826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.447050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.448210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:56.449301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.451875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.476776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 622/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:56.485014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.662359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eec4d-3b04-4273-95fc-8ddee7bb0e60 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.710383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.711471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.711957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.712444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.727616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.731128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:56.752680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:56.754426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:05:56.756196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 636/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:56.764375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.958667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c861-8907-4a74-b053-99c3b08b951c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:57.037759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c98ca3-4485-431a-9f6b-57664dce5ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:57.038761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c98ca3-4485-431a-9f6b-57664dce5ac7 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:57.039228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c98ca3-4485-431a-9f6b-57664dce5ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:57.039703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c98ca3-4485-431a-9f6b-57664dce5ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:57.041034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c98ca3-4485-431a-9f6b-57664dce5ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:57.041584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c98ca3-4485-431a-9f6b-57664dce5ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:57.045772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c98ca3-4485-431a-9f6b-57664dce5ac7 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:57.070833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 623/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:57.077549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:57.115003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:57.223928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288de164-8f1f-47c6-b135-4aa2130ad4fe None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:57.273730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d527436-7e98-450a-afa0-1673d7b715c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:57.274369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527436-7e98-450a-afa0-1673d7b715c8 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:57.274694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527436-7e98-450a-afa0-1673d7b715c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:57.275009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527436-7e98-450a-afa0-1673d7b715c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:57.276172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527436-7e98-450a-afa0-1673d7b715c8 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a3f84705571649b2bc20ec777e1e6a31) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:57.277285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527436-7e98-450a-afa0-1673d7b715c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:57.279002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527436-7e98-450a-afa0-1673d7b715c8 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:57.285900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 637/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:05:57 2022] GET /identity/v3/role_assignments?user.id=a3f84705571649b2bc20ec777e1e6a31&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:59.612790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eede4d-e91a-4cf1-a601-d8caf1d6dd4b None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:59.613459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eede4d-e91a-4cf1-a601-d8caf1d6dd4b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:59.613459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eede4d-e91a-4cf1-a601-d8caf1d6dd4b None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:59.614707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 624/1261] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:05:59.623531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf4ddd-8fd8-4a49-9f22-3a63b5e333f3 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:59.624288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf4ddd-8fd8-4a49-9f22-3a63b5e333f3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:59.624288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf4ddd-8fd8-4a49-9f22-3a63b5e333f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:59.644533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-70bf4ddd-8fd8-4a49-9f22-3a63b5e333f3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:59.645796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-70bf4ddd-8fd8-4a49-9f22-3a63b5e333f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:59.738462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 638/1262] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:06:00.020344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eede4d-e91a-4cf1-a601-d8caf1d6dd4b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.040140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.161900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eede4d-e91a-4cf1-a601-d8caf1d6dd4b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.215351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.216488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.217002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.217550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.239513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:06:00.249953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:00.251781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:06:00.254742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 625/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:00.260852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf4ddd-8fd8-4a49-9f22-3a63b5e333f3 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.302872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.403203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf4ddd-8fd8-4a49-9f22-3a63b5e333f3 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.445638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.446262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.446542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.446814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.447497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:00.447801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.449837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.460269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 639/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:00.469185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.551025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.599580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce095a6-eba7-43a7-99d5-55f2396a1362 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.646452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.647486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.647486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.647762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.660643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.662177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:06:00.680902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:00.683255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:06:00.684410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:06:00.684410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:00.684410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:06:00.684410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 626/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:00.689338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.799817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.829212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204103-c38a-4aeb-8c1e-84afcb71277d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.891760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.892715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.893245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.893729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.894906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:00.895448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.898099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.913592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 640/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:06:00.920076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.086658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28bbe1-af88-49b4-9dcb-c7e3d41c743c None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.119046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:01.138267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.139138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.139652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.140024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] PATH_INFO: `/v3/users/placement` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.154534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.157149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:06:01.176462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:01.178406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:06:01.180516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 627/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:01.186968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.329579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b79e5-d733-46cd-8026-111a013ae119 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.381376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.382619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.383057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.383436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.384600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:01.385124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.388540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.403608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:01.415408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 641/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:01.422398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.567265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29535ab-2949-45ca-b1b2-25e204d45ede None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.616199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.616851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.617187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.617490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.630934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.632934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:06:01.651192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:01.669872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:06:01.671632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:06:01.671632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:01.671632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:06:01.671632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 628/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:01.672068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.797665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc593e9-ceb4-48d6-ab19-ccbf51685220 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.840578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.841143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.841425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.841697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.842414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:01.842719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.844153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.858690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 642/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:01.865893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.920024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:02.053637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0bbc-ca10-442c-a3e5-6907f032853b None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:02.124239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:02.125190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:02.125647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:02.126083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:02.139903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:02.142762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:06:02.165168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:02.171837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:06:02.173693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 629/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:02.176160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:02.260063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:02.311025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0decbd-203c-45c5-b45d-b35619f5c86d None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:02.371305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab74a44-5499-4298-b07a-95ccb8a90f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:02.372367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74a44-5499-4298-b07a-95ccb8a90f1c None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:02.372833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74a44-5499-4298-b07a-95ccb8a90f1c None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:02.373117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74a44-5499-4298-b07a-95ccb8a90f1c None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:02.374281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab74a44-5499-4298-b07a-95ccb8a90f1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:02.374841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab74a44-5499-4298-b07a-95ccb8a90f1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:02.377845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab74a44-5499-4298-b07a-95ccb8a90f1c None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:02.392755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 643/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:02.399382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:02.531905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:02.544849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e00565-ab1c-4d7b-81da-64a13e471d62 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:02.594902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9c302-0811-40d0-b800-f9c766d37c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:02.595917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c302-0811-40d0-b800-f9c766d37c5d None admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:02.596298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c302-0811-40d0-b800-f9c766d37c5d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:02.596700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c302-0811-40d0-b800-f9c766d37c5d None admin] PATH_INFO: `/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a3f84705571649b2bc20ec777e1e6a31/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:02.599536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9c302-0811-40d0-b800-f9c766d37c5d None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad5e20a1004915a5f124122a9ea638, user_id=a3f84705571649b2bc20ec777e1e6a31, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:02.601744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9c302-0811-40d0-b800-f9c766d37c5d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:02.753021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 630/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Fri Sep 2 21:06:02 2022] PUT /identity/v3/projects/c0ad5e20a1004915a5f124122a9ea638/users/a3f84705571649b2bc20ec777e1e6a31/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:06:04.914296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f5d99-880f-49f5-91ce-100deada6a61 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:04.914892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f5d99-880f-49f5-91ce-100deada6a61 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:04.915035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f5d99-880f-49f5-91ce-100deada6a61 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:04.916481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 644/1274] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:04.923930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf752-f2ca-422e-874b-f1c8a42820a3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:04.924557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf752-f2ca-422e-874b-f1c8a42820a3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:04.924998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf752-f2ca-422e-874b-f1c8a42820a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:04.955220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-fbaaf752-f2ca-422e-874b-f1c8a42820a3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:04.956471 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fbaaf752-f2ca-422e-874b-f1c8a42820a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:05.057979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 631/1275] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:06:05.346791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f5d99-880f-49f5-91ce-100deada6a61 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:05.464623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f5d99-880f-49f5-91ce-100deada6a61 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:05.485404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:05.504709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:05.505508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:05.506173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:05.506371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:05.518592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:06:05.523800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:05.527890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:05.529004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 645/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Fri Sep 2 21:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:05.535130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf752-f2ca-422e-874b-f1c8a42820a3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:05.644873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:05.667987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf752-f2ca-422e-874b-f1c8a42820a3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:05.712189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:05.713282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:05.713546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:05.714027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:05.715251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:05.715778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:05.718346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:05.730088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 632/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Fri Sep 2 21:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:05.736411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:05.900324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ea1d4-6a75-4aa8-8951-19961e71be1b None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:05.966300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:05.967457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:05.968120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:05.968564 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:05.987692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:05.990319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:06:06.018500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:06.019790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:06:06.020891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:06:06.020891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:06.020891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:06.024979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 646/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:06.031069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:06.220356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b32f-13e6-4870-9f1f-fd21047d5462 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:06.280696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:06.281710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:06.282188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:06.282658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:06.283806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:06.284327 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:06.286919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:06.309547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 633/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:06.315701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:06.353030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:06.466230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67cf53-01b2-4f40-aaf7-bcfd7d8582c5 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:06.541262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:06.542810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:06.543315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:06.543816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:06.560584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:06.563555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:06:06.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:06.590170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:06.591417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 647/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:06.599540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:06.603887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:06.738411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38107e0-0b19-4f8a-9eb7-ad15f7eac9eb None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:06.778948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:06.779709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:06.780085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:06.780446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:06.781343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:06.781793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:06.783463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:06.806448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 634/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Fri Sep 2 21:06:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:06.813332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:06.984224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:07.004207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f044-0e95-40fc-8588-7a0cc4eb4f72 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:07.064442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:07.065070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:07.065391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:07.065700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:07.160917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:07.162436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:07.302683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:07.317501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 648/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Fri Sep 2 21:06:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:06:07.326239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:07.401059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:07.464484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356bfd2-a537-4d19-b1b9-e9132adb3397 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:07.508021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:07.509847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:07.509847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:07.511043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:07.528208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:07.529718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:06:07.546584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:07.548539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:06:07.550582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:06:07.550582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:07.550582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:06:07.550582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 635/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:07.555393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:07.688404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d06a77-4511-48db-9f67-c2929fe62085 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:07.739755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:07.740849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:07.741333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:07.741810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:07.742976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:07.743526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:07.747211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:07.778001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 649/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Fri Sep 2 21:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:07.780155 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:07.909954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff34f-e608-4417-86ba-15f0609b2486 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:07.926938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:07.952506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:07.953108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:07.953381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:07.953651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:07.961733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:07.963249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:06:07.978253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:07.980964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: ERROR keystone.server.flask.application Sep 02 21:06:07.982975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 636/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Fri Sep 2 21:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:07.987667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:08.068622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:08.145662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4493db-af29-4b43-9729-bb21af805cba None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:08.199003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c68a6-197a-4f32-932a-fb1cfc222034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:08.199647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c68a6-197a-4f32-932a-fb1cfc222034 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:08.200123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c68a6-197a-4f32-932a-fb1cfc222034 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:08.200400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c68a6-197a-4f32-932a-fb1cfc222034 None admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:08.201182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c68a6-197a-4f32-932a-fb1cfc222034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:08.201494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c68a6-197a-4f32-932a-fb1cfc222034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:08.203111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c68a6-197a-4f32-932a-fb1cfc222034 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:08.218637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 650/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Fri Sep 2 21:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:08.225753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:08.373508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658435ee-03e3-4abd-bdb1-c03d8375f377 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:08.442915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e94e5-982a-445e-bf0e-1aa710a07d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:08.443985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e94e5-982a-445e-bf0e-1aa710a07d92 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:08.444460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e94e5-982a-445e-bf0e-1aa710a07d92 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:08.445016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e94e5-982a-445e-bf0e-1aa710a07d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:08.446435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e94e5-982a-445e-bf0e-1aa710a07d92 None admin] RBAC: Adding query filter params (role.id=b10f30fad85f46e1be0c6205b9835be6, scope.project.id=c0ad5e20a1004915a5f124122a9ea638, user.id=a3f84705571649b2bc20ec777e1e6a31) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:08.447001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e94e5-982a-445e-bf0e-1aa710a07d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:08.450457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e94e5-982a-445e-bf0e-1aa710a07d92 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:08.461711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 637/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Fri Sep 2 21:06:08 2022] GET /identity/v3/role_assignments?user.id=a3f84705571649b2bc20ec777e1e6a31&scope.project.id=c0ad5e20a1004915a5f124122a9ea638&role.id=b10f30fad85f46e1be0c6205b9835be6 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:06:10.969288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d479-c12e-4005-936c-ae330e55d153 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:10.969908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d479-c12e-4005-936c-ae330e55d153 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:10.970005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d479-c12e-4005-936c-ae330e55d153 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:10.971321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 651/1288] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:06:10.977740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13ece1-3913-47e0-bb85-2312c8f94c57 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:10.978266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13ece1-3913-47e0-bb85-2312c8f94c57 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:10.978266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13ece1-3913-47e0-bb85-2312c8f94c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:10.997733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bc13ece1-3913-47e0-bb85-2312c8f94c57 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:10.998966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bc13ece1-3913-47e0-bb85-2312c8f94c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:11.033966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:11.078448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 638/1289] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:06:11.357663 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d479-c12e-4005-936c-ae330e55d153 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:11.472690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d479-c12e-4005-936c-ae330e55d153 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:11.488283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:11.524160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:11.524840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:11.535042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:11.535042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:11.535042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:11.535042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:11.537820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:11.539124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:11.540122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 652/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:06:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:06:11.546624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13ece1-3913-47e0-bb85-2312c8f94c57 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:11.656636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13ece1-3913-47e0-bb85-2312c8f94c57 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:11.696103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fd094-cd31-4aa8-9182-a8eac1e64ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:11.696714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd094-cd31-4aa8-9182-a8eac1e64ab4 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:11.697023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd094-cd31-4aa8-9182-a8eac1e64ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:11.697299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd094-cd31-4aa8-9182-a8eac1e64ab4 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:11.698484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fd094-cd31-4aa8-9182-a8eac1e64ab4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:11.698786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fd094-cd31-4aa8-9182-a8eac1e64ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:11.700394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fd094-cd31-4aa8-9182-a8eac1e64ab4 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:11.706258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 639/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:11.712558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:11.848646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b61ab6-f75e-45ea-a1b1-0c44973bf9b3 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:11.887744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e344a-ceeb-4dbc-adba-6f9e91e8ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:11.888543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e344a-ceeb-4dbc-adba-6f9e91e8ef15 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:11.888958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e344a-ceeb-4dbc-adba-6f9e91e8ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:11.889340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e344a-ceeb-4dbc-adba-6f9e91e8ef15 None admin] PATH_INFO: `/v3/services` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:11.890267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e344a-ceeb-4dbc-adba-6f9e91e8ef15 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:11.890656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e344a-ceeb-4dbc-adba-6f9e91e8ef15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:11.892299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e344a-ceeb-4dbc-adba-6f9e91e8ef15 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:11.897552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 653/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:14.079378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947b711-d792-4457-8bcb-431a6549dd82 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:14.079994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947b711-d792-4457-8bcb-431a6549dd82 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:14.080274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947b711-d792-4457-8bcb-431a6549dd82 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:14.082881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 640/1293] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:06:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:14.090141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502248-f67b-4663-a12a-783f1cd00e7d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:14.090819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502248-f67b-4663-a12a-783f1cd00e7d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:14.090819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502248-f67b-4663-a12a-783f1cd00e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:14.112006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-19502248-f67b-4663-a12a-783f1cd00e7d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:14.113299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-19502248-f67b-4663-a12a-783f1cd00e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:14.159528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:14.220506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 654/1294] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:06:14.753095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947b711-d792-4457-8bcb-431a6549dd82 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:14.813103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:14.925620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947b711-d792-4457-8bcb-431a6549dd82 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:14.981145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e39cc7-5d5e-4590-b2c6-59ca7855bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:14.981884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e39cc7-5d5e-4590-b2c6-59ca7855bbf3 None admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:14.982285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e39cc7-5d5e-4590-b2c6-59ca7855bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:14.982670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e39cc7-5d5e-4590-b2c6-59ca7855bbf3 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:14.983418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e39cc7-5d5e-4590-b2c6-59ca7855bbf3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:14.984960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e39cc7-5d5e-4590-b2c6-59ca7855bbf3 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:15.151674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 641/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Fri Sep 2 21:06:14 2022] POST /identity/v3/services => generated 246 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:06:17.383481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec778f-4eb0-431a-bc83-079218351451 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:17.384165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec778f-4eb0-431a-bc83-079218351451 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:17.384447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec778f-4eb0-431a-bc83-079218351451 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:17.387363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 655/1296] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:06:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:17.393931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d56fe-4b77-4e7e-afc2-f68717abb57d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:17.394878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d56fe-4b77-4e7e-afc2-f68717abb57d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:17.395046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d56fe-4b77-4e7e-afc2-f68717abb57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:17.423804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bb6d56fe-4b77-4e7e-afc2-f68717abb57d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:17.425649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bb6d56fe-4b77-4e7e-afc2-f68717abb57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:17.536419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 642/1297] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:06:17.832608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec778f-4eb0-431a-bc83-079218351451 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:17.972401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec778f-4eb0-431a-bc83-079218351451 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:18.036569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:18.037227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:18.037554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:18.037876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:18.038659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:18.040588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:18.051322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:18.053750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:18.055798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 656/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:06:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:06:18.060670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d56fe-4b77-4e7e-afc2-f68717abb57d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:18.095637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:18.253660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d56fe-4b77-4e7e-afc2-f68717abb57d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:18.318062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:18.318905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:18.319370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:18.319830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:18.320931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:18.321410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:18.323071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:18.329990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 643/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:06:18.337290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:18.397584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:18.516844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139490c-808a-4aa5-98ff-a47c5eb6f8cd None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:18.561971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cb0fa-1fbe-42c4-85f3-a07039efcc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:18.562777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cb0fa-1fbe-42c4-85f3-a07039efcc19 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:18.563065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cb0fa-1fbe-42c4-85f3-a07039efcc19 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:18.563343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cb0fa-1fbe-42c4-85f3-a07039efcc19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:18.564080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cb0fa-1fbe-42c4-85f3-a07039efcc19 None admin] RBAC: Adding query filter params (interface=public, service_id=93d55c7dd353454b9a3c4a7114371dcf, region_id=RegionOne) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:18.564393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cb0fa-1fbe-42c4-85f3-a07039efcc19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:18.565859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cb0fa-1fbe-42c4-85f3-a07039efcc19 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:18.573499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 657/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Fri Sep 2 21:06:18 2022] GET /identity/v3/endpoints?service_id=93d55c7dd353454b9a3c4a7114371dcf&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:06:18.583310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:18.716536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4ad6d-16f0-4881-b402-02395ae449f9 None admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:18.759633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c72c9-0e27-4079-b014-6ca2d0cf729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:18.760648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c72c9-0e27-4079-b014-6ca2d0cf729d None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:18.761169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c72c9-0e27-4079-b014-6ca2d0cf729d None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:18.761705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c72c9-0e27-4079-b014-6ca2d0cf729d None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:18.762383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c72c9-0e27-4079-b014-6ca2d0cf729d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:18.763869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c72c9-0e27-4079-b014-6ca2d0cf729d None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:18.773908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 644/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Fri Sep 2 21:06:18 2022] GET /identity/v3/services => generated 2191 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:06:18.808620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:21.018364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa3d9-e5de-42a0-8b6a-beb2870ab0a3 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:21.019182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa3d9-e5de-42a0-8b6a-beb2870ab0a3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:21.019182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa3d9-e5de-42a0-8b6a-beb2870ab0a3 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:21.021590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 658/1302] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:21.030319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741d40-d0bd-4342-84c1-162019961bdb None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:21.031066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741d40-d0bd-4342-84c1-162019961bdb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:21.031066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741d40-d0bd-4342-84c1-162019961bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:21.052411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-08741d40-d0bd-4342-84c1-162019961bdb None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:21.053671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-08741d40-d0bd-4342-84c1-162019961bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:21.178565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 645/1303] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:06:21.631451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa3d9-e5de-42a0-8b6a-beb2870ab0a3 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:21.766140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:21.781652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa3d9-e5de-42a0-8b6a-beb2870ab0a3 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:21.848502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:21.849500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:21.850090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:21.850548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:21.852308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:21.854601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:21.865650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:21.867766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: ERROR keystone.server.flask.application Sep 02 21:06:21.868682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 659/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Fri Sep 2 21:06:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:06:21.875614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741d40-d0bd-4342-84c1-162019961bdb None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:22.007612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:22.038485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741d40-d0bd-4342-84c1-162019961bdb None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:22.085438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1212-56a8-4b37-a6b6-d5418ca55c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:22.086494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1212-56a8-4b37-a6b6-d5418ca55c0c None admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:22.086987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1212-56a8-4b37-a6b6-d5418ca55c0c None admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:22.087454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1212-56a8-4b37-a6b6-d5418ca55c0c None admin] PATH_INFO: `/v3/services` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:22.090074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1212-56a8-4b37-a6b6-d5418ca55c0c None admin] RBAC: Adding query filter params (name=placement) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:22.090637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1212-56a8-4b37-a6b6-d5418ca55c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:22.093297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1212-56a8-4b37-a6b6-d5418ca55c0c None admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:22.103561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 646/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:06:22.112051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:22.287278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090181dc-1534-4bcf-9db6-46d2e62742d0 None admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:22.334920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4b270-6dd5-49c5-968a-071b6578693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:22.335912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4b270-6dd5-49c5-968a-071b6578693f None admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:22.336236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4b270-6dd5-49c5-968a-071b6578693f None admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:22.336562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4b270-6dd5-49c5-968a-071b6578693f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:22.337425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4b270-6dd5-49c5-968a-071b6578693f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:22.339955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4b270-6dd5-49c5-968a-071b6578693f None admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:22.473990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 660/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:06:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:06:32.140249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=30 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:32.463963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:40.873213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64540ae-3350-4080-b470-33a844673336 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:40.879496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64540ae-3350-4080-b470-33a844673336 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:40.879496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64540ae-3350-4080-b470-33a844673336 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:40.881364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 647/1307] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:16:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:40.887112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04680e-da88-4592-8aa6-e50947b45c6b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:40.888669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04680e-da88-4592-8aa6-e50947b45c6b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:40.889735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04680e-da88-4592-8aa6-e50947b45c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:41.068337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4c04680e-da88-4592-8aa6-e50947b45c6b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:41.071945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4c04680e-da88-4592-8aa6-e50947b45c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:41.304866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 661/1308] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:41.737473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884bdc3-d9af-42d7-9e30-45da5143563d None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:41.740374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884bdc3-d9af-42d7-9e30-45da5143563d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:41.741574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884bdc3-d9af-42d7-9e30-45da5143563d None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:41.746934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 648/1309] 10.222.0.71 () {54 vars in 965 bytes} [Fri Sep 2 21:16:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:16:41.757409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eaeb6-c6e8-4625-bf5d-3f71e3d69de0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:41.758436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eaeb6-c6e8-4625-bf5d-3f71e3d69de0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:41.759131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eaeb6-c6e8-4625-bf5d-3f71e3d69de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:41.962718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-bb2eaeb6-c6e8-4625-bf5d-3f71e3d69de0 None None] MFA Rules not processed for user `9a588483344147629a6f557a54c34c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:41.965268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-bb2eaeb6-c6e8-4625-bf5d-3f71e3d69de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:42.022983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:42.144288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 662/1310] 10.222.0.71 () {58 vars in 1062 bytes} [Fri Sep 2 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:42.161390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884bdc3-d9af-42d7-9e30-45da5143563d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:42.164925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3884bdc3-d9af-42d7-9e30-45da5143563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:42.460553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884bdc3-d9af-42d7-9e30-45da5143563d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:42.612956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d948d2-5a18-49b7-bbb2-35a271377919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:42.613790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d948d2-5a18-49b7-bbb2-35a271377919 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:42.614133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d948d2-5a18-49b7-bbb2-35a271377919 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:42.614558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d948d2-5a18-49b7-bbb2-35a271377919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:42.618118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c4d948d2-5a18-49b7-bbb2-35a271377919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:42.715092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:42.832381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d948d2-5a18-49b7-bbb2-35a271377919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:42.836758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d948d2-5a18-49b7-bbb2-35a271377919 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:42.876824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 649/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:46.131382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8670-0abd-4723-8b5a-a4044e6929d3 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:46.132173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8670-0abd-4723-8b5a-a4044e6929d3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:46.132173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8670-0abd-4723-8b5a-a4044e6929d3 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:46.133413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 663/1312] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:46.140075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ae83-d0d7-465f-9cb9-7af822a02712 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:46.140672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ae83-d0d7-465f-9cb9-7af822a02712 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:46.140802 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ae83-d0d7-465f-9cb9-7af822a02712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:46.294312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8a47ae83-d0d7-465f-9cb9-7af822a02712 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:46.296316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8a47ae83-d0d7-465f-9cb9-7af822a02712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:46.470656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 650/1313] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:46.816016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b14f2-47ee-4f08-87a5-dfa4c839262e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:46.818344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b14f2-47ee-4f08-87a5-dfa4c839262e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:46.818344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b14f2-47ee-4f08-87a5-dfa4c839262e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:46.818344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 664/1314] 10.222.0.71 () {54 vars in 965 bytes} [Fri Sep 2 21:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:46.825341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939996b-49f5-48f1-85d2-45dfee4a2908 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:46.825659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939996b-49f5-48f1-85d2-45dfee4a2908 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:46.825943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939996b-49f5-48f1-85d2-45dfee4a2908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:46.839598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:46.947458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4939996b-49f5-48f1-85d2-45dfee4a2908 None None] MFA Rules not processed for user `9a588483344147629a6f557a54c34c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:46.948782 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4939996b-49f5-48f1-85d2-45dfee4a2908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:47.074331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 651/1315] 10.222.0.71 () {58 vars in 1062 bytes} [Fri Sep 2 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:47.089014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b14f2-47ee-4f08-87a5-dfa4c839262e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:47.092114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d12b14f2-47ee-4f08-87a5-dfa4c839262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:47.231818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b14f2-47ee-4f08-87a5-dfa4c839262e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:47.362456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:47.366830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d823aa6-e6bd-4456-8f01-05ac13dc7df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:47.367788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d823aa6-e6bd-4456-8f01-05ac13dc7df3 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:47.368226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d823aa6-e6bd-4456-8f01-05ac13dc7df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:47.368669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d823aa6-e6bd-4456-8f01-05ac13dc7df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:47.371698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3d823aa6-e6bd-4456-8f01-05ac13dc7df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:47.521274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d823aa6-e6bd-4456-8f01-05ac13dc7df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:47.523025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d823aa6-e6bd-4456-8f01-05ac13dc7df3 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:47.547491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 665/1316] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:50.887621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1535516-6b3a-42f7-a093-5c416e6d41a0 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:50.888386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1535516-6b3a-42f7-a093-5c416e6d41a0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:50.888607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1535516-6b3a-42f7-a093-5c416e6d41a0 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:50.890998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 652/1317] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:50.898609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc573f4-c4e0-443e-977c-3cfe9ed596d9 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:50.899258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc573f4-c4e0-443e-977c-3cfe9ed596d9 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:50.904654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc573f4-c4e0-443e-977c-3cfe9ed596d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:51.001062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-3bc573f4-c4e0-443e-977c-3cfe9ed596d9 None None] MFA Rules not processed for user `e3e2e0ab7b844088aa2497b543aa9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:51.002725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3bc573f4-c4e0-443e-977c-3cfe9ed596d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:51.093489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:51.150870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 666/1318] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:16:51.472116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1535516-6b3a-42f7-a093-5c416e6d41a0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:51.474905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b1535516-6b3a-42f7-a093-5c416e6d41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:51.633491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1535516-6b3a-42f7-a093-5c416e6d41a0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:51.637774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:51.743382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6216195-5f4a-42a6-b1d7-5d5dac8e28aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:51.744357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6216195-5f4a-42a6-b1d7-5d5dac8e28aa service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:51.744875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6216195-5f4a-42a6-b1d7-5d5dac8e28aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:51.745370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6216195-5f4a-42a6-b1d7-5d5dac8e28aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:51.748101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a6216195-5f4a-42a6-b1d7-5d5dac8e28aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:51.942238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6216195-5f4a-42a6-b1d7-5d5dac8e28aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:51.945129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6216195-5f4a-42a6-b1d7-5d5dac8e28aa service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:51.979350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 653/1319] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:55.895867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9b970-d788-4c5f-a4f8-01b57565408f None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:55.896771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9b970-d788-4c5f-a4f8-01b57565408f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:55.896771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9b970-d788-4c5f-a4f8-01b57565408f None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:55.898297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 667/1320] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:55.904103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9847998-c8f1-445c-85f0-a0717e44ac76 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:55.904612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9847998-c8f1-445c-85f0-a0717e44ac76 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:55.904838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9847998-c8f1-445c-85f0-a0717e44ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:55.969180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:56.010668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c9847998-c8f1-445c-85f0-a0717e44ac76 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:56.012804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c9847998-c8f1-445c-85f0-a0717e44ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:56.153575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 654/1321] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:56.459152 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9b970-d788-4c5f-a4f8-01b57565408f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:56.462066 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a3c9b970-d788-4c5f-a4f8-01b57565408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:56.631826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9b970-d788-4c5f-a4f8-01b57565408f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:56.753513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0c73-b30b-4463-a878-eeeeb02ef6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:56.754123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0c73-b30b-4463-a878-eeeeb02ef6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:56.754405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0c73-b30b-4463-a878-eeeeb02ef6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:56.754705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0c73-b30b-4463-a878-eeeeb02ef6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:56.757579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-918b0c73-b30b-4463-a878-eeeeb02ef6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:56.772548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:56.934181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0c73-b30b-4463-a878-eeeeb02ef6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:56.935712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0c73-b30b-4463-a878-eeeeb02ef6a7 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:56.957920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 668/1322] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:00.653558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62004723-0444-4558-959b-a34c7df6c160 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:00.654343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62004723-0444-4558-959b-a34c7df6c160 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:00.654343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62004723-0444-4558-959b-a34c7df6c160 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:00.656154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 655/1323] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:00.663106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a95ff-a5f8-4cdb-97cf-8e7174c2b82d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:00.663919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a95ff-a5f8-4cdb-97cf-8e7174c2b82d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:00.663919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a95ff-a5f8-4cdb-97cf-8e7174c2b82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:00.776486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-ff7a95ff-a5f8-4cdb-97cf-8e7174c2b82d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:00.779684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ff7a95ff-a5f8-4cdb-97cf-8e7174c2b82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:00.883499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:00.968111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 669/1324] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:01.276189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62004723-0444-4558-959b-a34c7df6c160 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:01.278013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-62004723-0444-4558-959b-a34c7df6c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:01.476637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62004723-0444-4558-959b-a34c7df6c160 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:01.505496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:01.606363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2bba-0297-40ec-b497-57a95f0e8c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:01.607016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2bba-0297-40ec-b497-57a95f0e8c57 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:01.607300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2bba-0297-40ec-b497-57a95f0e8c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:01.607579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2bba-0297-40ec-b497-57a95f0e8c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:01.609620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-377b2bba-0297-40ec-b497-57a95f0e8c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:01.790298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2bba-0297-40ec-b497-57a95f0e8c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:01.791777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2bba-0297-40ec-b497-57a95f0e8c57 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:01.822352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 656/1325] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:04.134457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233bbbc-b20a-4079-b5c4-d6229620b99a None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:04.135040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233bbbc-b20a-4079-b5c4-d6229620b99a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:04.135177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233bbbc-b20a-4079-b5c4-d6229620b99a None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:04.136758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 670/1326] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:04.144667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fb80a-29ef-453f-be0e-c8fd7c26784d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:04.146056 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fb80a-29ef-453f-be0e-c8fd7c26784d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:04.146230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fb80a-29ef-453f-be0e-c8fd7c26784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:04.222783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:04.246295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-404fb80a-29ef-453f-be0e-c8fd7c26784d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:04.247533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-404fb80a-29ef-453f-be0e-c8fd7c26784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:04.410717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 657/1327] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:04.766943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233bbbc-b20a-4079-b5c4-d6229620b99a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:04.770230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8233bbbc-b20a-4079-b5c4-d6229620b99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:04.938113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233bbbc-b20a-4079-b5c4-d6229620b99a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:05.063176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595ee62-1c83-496e-8408-e069ffcd302e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:05.063971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595ee62-1c83-496e-8408-e069ffcd302e service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:05.064306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595ee62-1c83-496e-8408-e069ffcd302e service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:05.064635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595ee62-1c83-496e-8408-e069ffcd302e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:05.066475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4595ee62-1c83-496e-8408-e069ffcd302e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:05.111215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:05.290027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595ee62-1c83-496e-8408-e069ffcd302e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:05.292959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595ee62-1c83-496e-8408-e069ffcd302e service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:05.332405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 671/1328] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:17:07.859946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6a50-165a-4632-9176-57422313a2b8 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:07.860800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6a50-165a-4632-9176-57422313a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:07.860800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a6a50-165a-4632-9176-57422313a2b8 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:07.862073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 658/1329] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:07.871065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfe08-48f5-4fa7-9a76-d19ded533252 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:07.871959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfe08-48f5-4fa7-9a76-d19ded533252 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:07.871959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfe08-48f5-4fa7-9a76-d19ded533252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:07.969608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-01fdfe08-48f5-4fa7-9a76-d19ded533252 None None] MFA Rules not processed for user `e3e2e0ab7b844088aa2497b543aa9b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:07.970889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-01fdfe08-48f5-4fa7-9a76-d19ded533252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:08.091482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:08.139859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 672/1330] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:08.448436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6a50-165a-4632-9176-57422313a2b8 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:08.450322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4f5a6a50-165a-4632-9176-57422313a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:08.608887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a6a50-165a-4632-9176-57422313a2b8 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:08.635411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:08.708565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627251b-1e9a-42c5-953a-0af9891b1569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:08.709223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627251b-1e9a-42c5-953a-0af9891b1569 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:08.709499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627251b-1e9a-42c5-953a-0af9891b1569 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:08.709775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627251b-1e9a-42c5-953a-0af9891b1569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:08.711489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6627251b-1e9a-42c5-953a-0af9891b1569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:08.870248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627251b-1e9a-42c5-953a-0af9891b1569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:08.871604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627251b-1e9a-42c5-953a-0af9891b1569 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:08.893131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 659/1331] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:11.678073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853723a-3133-46bb-ab5d-39acee95245f None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:11.678769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853723a-3133-46bb-ab5d-39acee95245f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:11.678769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853723a-3133-46bb-ab5d-39acee95245f None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:11.679974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 673/1332] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:11.687016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052ea5e-6094-4306-96f2-c13ebf9f5248 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:11.687552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052ea5e-6094-4306-96f2-c13ebf9f5248 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:11.687552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052ea5e-6094-4306-96f2-c13ebf9f5248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:11.774350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:11.778256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e052ea5e-6094-4306-96f2-c13ebf9f5248 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:11.779581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e052ea5e-6094-4306-96f2-c13ebf9f5248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:11.898372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 660/1333] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:12.202856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853723a-3133-46bb-ab5d-39acee95245f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:12.204452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d853723a-3133-46bb-ab5d-39acee95245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:12.337208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853723a-3133-46bb-ab5d-39acee95245f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:12.438735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3a6ae-3745-4a5f-9840-24d95a6a83a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:12.439344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3a6ae-3745-4a5f-9840-24d95a6a83a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:12.439624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3a6ae-3745-4a5f-9840-24d95a6a83a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:12.439895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3a6ae-3745-4a5f-9840-24d95a6a83a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:12.441551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-32e3a6ae-3745-4a5f-9840-24d95a6a83a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:12.472135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:12.580489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3a6ae-3745-4a5f-9840-24d95a6a83a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:12.583854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3a6ae-3745-4a5f-9840-24d95a6a83a2 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:12.604711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 674/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:14.688555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785e4c2-196b-4e41-b0e0-1300d62844f4 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:14.689703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785e4c2-196b-4e41-b0e0-1300d62844f4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:14.689703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785e4c2-196b-4e41-b0e0-1300d62844f4 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:14.690324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 661/1335] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:17:14.695989 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a99d7-91d2-4e4e-9923-e6f6b0465d14 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:14.696461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a99d7-91d2-4e4e-9923-e6f6b0465d14 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:14.696573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a99d7-91d2-4e4e-9923-e6f6b0465d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:14.784114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f91a99d7-91d2-4e4e-9923-e6f6b0465d14 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:14.786657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f91a99d7-91d2-4e4e-9923-e6f6b0465d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:14.892466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:14.917933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 675/1336] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:15.219606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785e4c2-196b-4e41-b0e0-1300d62844f4 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:15.221195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c785e4c2-196b-4e41-b0e0-1300d62844f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:15.359255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785e4c2-196b-4e41-b0e0-1300d62844f4 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:15.398096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:15.452568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd3e31-56b3-4cdc-b587-b9dbe21c6af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:15.453202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3e31-56b3-4cdc-b587-b9dbe21c6af4 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:15.453477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3e31-56b3-4cdc-b587-b9dbe21c6af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:15.453744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3e31-56b3-4cdc-b587-b9dbe21c6af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:15.455398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-10dd3e31-56b3-4cdc-b587-b9dbe21c6af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:15.602824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd3e31-56b3-4cdc-b587-b9dbe21c6af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:15.604285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd3e31-56b3-4cdc-b587-b9dbe21c6af4 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:15.624815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 662/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:18.979730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526cb2-319a-4c2b-b353-1141684d1137 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:18.980275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526cb2-319a-4c2b-b353-1141684d1137 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:18.980552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526cb2-319a-4c2b-b353-1141684d1137 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:18.983173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 676/1338] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:18.989535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee461-4750-4704-b94c-5c0f897006a9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:18.990217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee461-4750-4704-b94c-5c0f897006a9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:18.990217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee461-4750-4704-b94c-5c0f897006a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:19.071554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ac6ee461-4750-4704-b94c-5c0f897006a9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:19.073176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ac6ee461-4750-4704-b94c-5c0f897006a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:19.089970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:19.229531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 663/1339] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:17:19.523868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526cb2-319a-4c2b-b353-1141684d1137 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:19.525621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c7526cb2-319a-4c2b-b353-1141684d1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:19.655722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526cb2-319a-4c2b-b353-1141684d1137 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:19.766219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfc387-9617-43ba-83c8-110cf794861e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:19.766829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfc387-9617-43ba-83c8-110cf794861e service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:19.767105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfc387-9617-43ba-83c8-110cf794861e service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:19.767373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfc387-9617-43ba-83c8-110cf794861e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:19.769081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-48dfc387-9617-43ba-83c8-110cf794861e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:19.815340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:19.912059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfc387-9617-43ba-83c8-110cf794861e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:19.913470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfc387-9617-43ba-83c8-110cf794861e service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:19.935209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 677/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:17:25.516272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8c23c-9ddb-4138-a81b-b50543b4dfb9 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:25.516772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8c23c-9ddb-4138-a81b-b50543b4dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:25.517135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8c23c-9ddb-4138-a81b-b50543b4dfb9 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:25.518898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 664/1341] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:25.525935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3529c-e7ef-4664-bc23-34cbc4b8bffa None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:25.526607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3529c-e7ef-4664-bc23-34cbc4b8bffa None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:25.526607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3529c-e7ef-4664-bc23-34cbc4b8bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:25.643759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-44f3529c-e7ef-4664-bc23-34cbc4b8bffa None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:25.646033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-44f3529c-e7ef-4664-bc23-34cbc4b8bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:25.795035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:25.816999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 678/1342] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:26.195062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8c23c-9ddb-4138-a81b-b50543b4dfb9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:26.198061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-cbd8c23c-9ddb-4138-a81b-b50543b4dfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:26.392340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8c23c-9ddb-4138-a81b-b50543b4dfb9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:26.445630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:26.518178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eb453-c4ac-4908-af41-104f1f5aa71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:26.519199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eb453-c4ac-4908-af41-104f1f5aa71a service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:26.521318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eb453-c4ac-4908-af41-104f1f5aa71a service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:26.521788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eb453-c4ac-4908-af41-104f1f5aa71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:26.524654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d38eb453-c4ac-4908-af41-104f1f5aa71a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:26.738856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eb453-c4ac-4908-af41-104f1f5aa71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:26.741004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eb453-c4ac-4908-af41-104f1f5aa71a service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:26.785525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 665/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:30.424904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41b8a-47ca-403c-ab9b-96eef3c77649 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:30.425768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41b8a-47ca-403c-ab9b-96eef3c77649 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:30.425954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41b8a-47ca-403c-ab9b-96eef3c77649 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:30.428479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 679/1344] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:30.438354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a1e5-bbaa-49b1-9b30-c60e52aa7f88 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:30.439023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a1e5-bbaa-49b1-9b30-c60e52aa7f88 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:30.439493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711a1e5-bbaa-49b1-9b30-c60e52aa7f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:30.552006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7711a1e5-bbaa-49b1-9b30-c60e52aa7f88 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:30.553791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7711a1e5-bbaa-49b1-9b30-c60e52aa7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:30.581258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:30.734228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 666/1345] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:31.099523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de41b8a-47ca-403c-ab9b-96eef3c77649 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:31.102545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4de41b8a-47ca-403c-ab9b-96eef3c77649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:31.280703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de41b8a-47ca-403c-ab9b-96eef3c77649 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:31.391810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4200ee-eba4-4576-9679-b56722472560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:31.391810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4200ee-eba4-4576-9679-b56722472560 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:31.392178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4200ee-eba4-4576-9679-b56722472560 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:31.392347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4200ee-eba4-4576-9679-b56722472560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:31.394769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4b4200ee-eba4-4576-9679-b56722472560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:31.455151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:31.539677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4200ee-eba4-4576-9679-b56722472560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:31.541412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4200ee-eba4-4576-9679-b56722472560 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:31.566527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 680/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:36.777940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6383d9b-7b2c-4627-8f89-d573a2f001d5 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:36.778474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6383d9b-7b2c-4627-8f89-d573a2f001d5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:36.778553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6383d9b-7b2c-4627-8f89-d573a2f001d5 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:36.780598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 667/1347] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:36.788344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d07ac0-f48e-4f87-9767-90aa0a9d11b1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:36.788952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d07ac0-f48e-4f87-9767-90aa0a9d11b1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:36.788952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d07ac0-f48e-4f87-9767-90aa0a9d11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:36.876040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e1d07ac0-f48e-4f87-9767-90aa0a9d11b1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:36.877227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e1d07ac0-f48e-4f87-9767-90aa0a9d11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:37.002249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:37.006154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 681/1348] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:37.317396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6383d9b-7b2c-4627-8f89-d573a2f001d5 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:37.320592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a6383d9b-7b2c-4627-8f89-d573a2f001d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:37.484587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6383d9b-7b2c-4627-8f89-d573a2f001d5 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:37.568033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:37.594683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bb1d5-3e77-4f86-9bf3-2e79dfe1c12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:37.595826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb1d5-3e77-4f86-9bf3-2e79dfe1c12f service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:37.595826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb1d5-3e77-4f86-9bf3-2e79dfe1c12f service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:37.595826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb1d5-3e77-4f86-9bf3-2e79dfe1c12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:37.598379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ec4bb1d5-3e77-4f86-9bf3-2e79dfe1c12f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:37.736406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bb1d5-3e77-4f86-9bf3-2e79dfe1c12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:37.737898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bb1d5-3e77-4f86-9bf3-2e79dfe1c12f service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:37.758217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 668/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:43.324665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2ec4-6541-46ed-a72e-66ce10ee8e35 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:43.325215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2ec4-6541-46ed-a72e-66ce10ee8e35 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:43.325432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2ec4-6541-46ed-a72e-66ce10ee8e35 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:43.327078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 682/1350] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:43.334906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66168e27-217a-4522-88a2-79d87028f078 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:43.335434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66168e27-217a-4522-88a2-79d87028f078 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:43.335434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66168e27-217a-4522-88a2-79d87028f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:43.454779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-66168e27-217a-4522-88a2-79d87028f078 None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:43.456381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-66168e27-217a-4522-88a2-79d87028f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:43.482861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:43.616002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 669/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:49.110452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62fad6-c12b-4902-8eae-684a92301ca3 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:49.111098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62fad6-c12b-4902-8eae-684a92301ca3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:49.111374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62fad6-c12b-4902-8eae-684a92301ca3 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:49.113525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 683/1352] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:17:49.120945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996a708-d8b1-4f55-8f8d-287ebccde462 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:49.121507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996a708-d8b1-4f55-8f8d-287ebccde462 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:49.121593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996a708-d8b1-4f55-8f8d-287ebccde462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:49.246495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-d996a708-d8b1-4f55-8f8d-287ebccde462 None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:49.248076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d996a708-d8b1-4f55-8f8d-287ebccde462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:49.406033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:49.464993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 670/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:17:51.079855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d026c0-61b5-4e6e-a443-b4f76663f918 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:51.080602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d026c0-61b5-4e6e-a443-b4f76663f918 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:51.080602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d026c0-61b5-4e6e-a443-b4f76663f918 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:51.082613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 684/1354] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:17:51.090301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73f61-662d-4b74-892e-b93b0a6651c0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:51.091055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73f61-662d-4b74-892e-b93b0a6651c0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:51.091565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73f61-662d-4b74-892e-b93b0a6651c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:51.189439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a3b73f61-662d-4b74-892e-b93b0a6651c0 None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:51.191375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a3b73f61-662d-4b74-892e-b93b0a6651c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:51.341265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 671/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:55.341706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13891-4b33-4212-8020-fc1a579f1902 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:55.342838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13891-4b33-4212-8020-fc1a579f1902 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:55.343345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13891-4b33-4212-8020-fc1a579f1902 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:55.345463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 685/1356] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:55.351961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ae4d-b0ba-47ce-b9a4-ba599a3b1ddb None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:55.352566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ae4d-b0ba-47ce-b9a4-ba599a3b1ddb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:55.352566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ae4d-b0ba-47ce-b9a4-ba599a3b1ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:55.404235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:55.464760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9ec9ae4d-b0ba-47ce-b9a4-ba599a3b1ddb None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:55.466263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ec9ae4d-b0ba-47ce-b9a4-ba599a3b1ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:55.687557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 672/1357] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:56.095475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462c5d-bec3-4044-8ec4-4243aa5c137c None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:56.098304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462c5d-bec3-4044-8ec4-4243aa5c137c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:56.098304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462c5d-bec3-4044-8ec4-4243aa5c137c None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:56.102573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 686/1358] 10.222.0.71 () {54 vars in 962 bytes} [Fri Sep 2 21:17:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:56.112970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8800-dcee-46af-be59-f3ab3433355f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:56.113378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8800-dcee-46af-be59-f3ab3433355f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:56.113633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8800-dcee-46af-be59-f3ab3433355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:56.245362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-80cb8800-dcee-46af-be59-f3ab3433355f None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:56.246809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-80cb8800-dcee-46af-be59-f3ab3433355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:56.332848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:56.481973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 673/1359] 10.222.0.71 () {58 vars in 1059 bytes} [Fri Sep 2 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:17:56.494840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c462c5d-bec3-4044-8ec4-4243aa5c137c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:56.496657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4c462c5d-bec3-4044-8ec4-4243aa5c137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:56.802564 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c462c5d-bec3-4044-8ec4-4243aa5c137c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:56.934217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:56.997174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d99ff9-f5fd-44bf-91ab-a7e70b95ed9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:56.997174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99ff9-f5fd-44bf-91ab-a7e70b95ed9b service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:56.997174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99ff9-f5fd-44bf-91ab-a7e70b95ed9b service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:56.997174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99ff9-f5fd-44bf-91ab-a7e70b95ed9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:56.997855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a9d99ff9-f5fd-44bf-91ab-a7e70b95ed9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:57.113931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d99ff9-f5fd-44bf-91ab-a7e70b95ed9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:57.115652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d99ff9-f5fd-44bf-91ab-a7e70b95ed9b service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:57.138274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 687/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:17:59.526205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bbdb-d170-4068-a2f1-ffc108a597cf None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:59.526785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bbdb-d170-4068-a2f1-ffc108a597cf None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:59.527011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bbdb-d170-4068-a2f1-ffc108a597cf None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:59.528653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 674/1361] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:59.534875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735d2d-fd0e-451c-8c27-11e06ef159f4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:59.535447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735d2d-fd0e-451c-8c27-11e06ef159f4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:59.535626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735d2d-fd0e-451c-8c27-11e06ef159f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:59.622501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b7735d2d-fd0e-451c-8c27-11e06ef159f4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:59.623615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b7735d2d-fd0e-451c-8c27-11e06ef159f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:59.669209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:59.748958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 688/1362] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:18:00.076384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bbdb-d170-4068-a2f1-ffc108a597cf None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:00.077901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-77a6bbdb-d170-4068-a2f1-ffc108a597cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:00.267587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bbdb-d170-4068-a2f1-ffc108a597cf None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:00.278874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:00.405454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abc3a0-211b-460a-bf06-ba674ea301dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:00.406010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abc3a0-211b-460a-bf06-ba674ea301dd service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:00.406255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abc3a0-211b-460a-bf06-ba674ea301dd service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:00.406557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abc3a0-211b-460a-bf06-ba674ea301dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:00.408295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-58abc3a0-211b-460a-bf06-ba674ea301dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:00.525695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abc3a0-211b-460a-bf06-ba674ea301dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:00.527454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abc3a0-211b-460a-bf06-ba674ea301dd service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:00.553132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 675/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:03.167480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01135014-2b79-4c8d-b433-0b6c7e3abab5 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:03.168460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01135014-2b79-4c8d-b433-0b6c7e3abab5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:03.168974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01135014-2b79-4c8d-b433-0b6c7e3abab5 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:03.170534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 689/1364] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:03.177284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46475d9b-01e1-4b81-988b-5878d4e2d16b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:03.177816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46475d9b-01e1-4b81-988b-5878d4e2d16b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:03.177910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46475d9b-01e1-4b81-988b-5878d4e2d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:03.199533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:03.278905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-46475d9b-01e1-4b81-988b-5878d4e2d16b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:03.280587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-46475d9b-01e1-4b81-988b-5878d4e2d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:03.401808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 676/1365] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:03.748219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e99e9-5408-41d7-818e-0045c6e8c713 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:03.748559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e99e9-5408-41d7-818e-0045c6e8c713 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:03.748852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e99e9-5408-41d7-818e-0045c6e8c713 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:03.750537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 690/1366] 10.222.0.71 () {54 vars in 962 bytes} [Fri Sep 2 21:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:03.759271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0903954-f0a3-4590-bc4a-4cf026386f62 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:03.763876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0903954-f0a3-4590-bc4a-4cf026386f62 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:03.763876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0903954-f0a3-4590-bc4a-4cf026386f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:03.853242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f0903954-f0a3-4590-bc4a-4cf026386f62 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:03.854464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f0903954-f0a3-4590-bc4a-4cf026386f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:03.901558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:04.025845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 677/1367] 10.222.0.71 () {58 vars in 1059 bytes} [Fri Sep 2 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:04.034220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e99e9-5408-41d7-818e-0045c6e8c713 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:04.036679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-304e99e9-5408-41d7-818e-0045c6e8c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:04.247206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e99e9-5408-41d7-818e-0045c6e8c713 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:04.272978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:04.402425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fece-89d8-459c-96cf-7b8da0213b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:04.402938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fece-89d8-459c-96cf-7b8da0213b5e service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:04.403227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fece-89d8-459c-96cf-7b8da0213b5e service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:04.403531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fece-89d8-459c-96cf-7b8da0213b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:04.405468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b938fece-89d8-459c-96cf-7b8da0213b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:04.555688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fece-89d8-459c-96cf-7b8da0213b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:04.557418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fece-89d8-459c-96cf-7b8da0213b5e service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:04.580547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 691/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:05.054857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9d8b-02cf-403b-b8e8-b6c2c11b2c7f None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:05.055393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9d8b-02cf-403b-b8e8-b6c2c11b2c7f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:05.055535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9d8b-02cf-403b-b8e8-b6c2c11b2c7f None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:05.057617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 678/1369] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:05.063731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091211-3db1-4dbb-a028-6e862b9205e2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:05.064306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091211-3db1-4dbb-a028-6e862b9205e2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:05.065675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091211-3db1-4dbb-a028-6e862b9205e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:05.126543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:05.177754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-be091211-3db1-4dbb-a028-6e862b9205e2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:05.179203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-be091211-3db1-4dbb-a028-6e862b9205e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:05.294543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 692/1370] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:05.936803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3ac5-fa04-43b7-8da6-2fa15cec3460 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:05.937527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3ac5-fa04-43b7-8da6-2fa15cec3460 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:05.938042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3ac5-fa04-43b7-8da6-2fa15cec3460 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:05.941301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 679/1371] 10.222.0.71 () {54 vars in 964 bytes} [Fri Sep 2 21:18:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:18:05.948235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ffbb-c2a1-48de-be72-eecf6cfb1569 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:05.948865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ffbb-c2a1-48de-be72-eecf6cfb1569 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:05.949353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ffbb-c2a1-48de-be72-eecf6cfb1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:06.054902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9790ffbb-c2a1-48de-be72-eecf6cfb1569 None None] MFA Rules not processed for user `fb8b75d3cf3b46a79706c74501dc874e`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:06.056193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9790ffbb-c2a1-48de-be72-eecf6cfb1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:06.117390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:06.158580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 693/1372] 10.222.0.71 () {58 vars in 1061 bytes} [Fri Sep 2 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:06.166997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3ac5-fa04-43b7-8da6-2fa15cec3460 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:06.169724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dafa3ac5-fa04-43b7-8da6-2fa15cec3460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:06.323323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3ac5-fa04-43b7-8da6-2fa15cec3460 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:06.384199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:06.431289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc6a1b-5e94-4360-b794-358c8ca9f2eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:06.432204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6a1b-5e94-4360-b794-358c8ca9f2eb service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:06.432512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6a1b-5e94-4360-b794-358c8ca9f2eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:06.432931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6a1b-5e94-4360-b794-358c8ca9f2eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:06.434796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-04bc6a1b-5e94-4360-b794-358c8ca9f2eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:06.719907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc6a1b-5e94-4360-b794-358c8ca9f2eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:06.722533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc6a1b-5e94-4360-b794-358c8ca9f2eb service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:06.753233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 680/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:07.191707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56b1bf-5b6b-4190-8959-fede84896f8e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:07.192258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56b1bf-5b6b-4190-8959-fede84896f8e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:07.200719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56b1bf-5b6b-4190-8959-fede84896f8e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:07.200719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 694/1374] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:07.203648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4c53-87d7-4198-a682-70f1f5c9fcf4 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:07.204112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4c53-87d7-4198-a682-70f1f5c9fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:07.204527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4c53-87d7-4198-a682-70f1f5c9fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:07.321525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-135b4c53-87d7-4198-a682-70f1f5c9fcf4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:07.323390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-135b4c53-87d7-4198-a682-70f1f5c9fcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:07.359435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:07.463686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 681/1375] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:07.761987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56b1bf-5b6b-4190-8959-fede84896f8e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:07.763620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3f56b1bf-5b6b-4190-8959-fede84896f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:07.960268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56b1bf-5b6b-4190-8959-fede84896f8e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:08.026489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:08.108334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d493c0a-f233-4c92-a16c-db1dbf465811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:08.108987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d493c0a-f233-4c92-a16c-db1dbf465811 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:08.109295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d493c0a-f233-4c92-a16c-db1dbf465811 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:08.109598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d493c0a-f233-4c92-a16c-db1dbf465811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:08.111285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8d493c0a-f233-4c92-a16c-db1dbf465811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:08.229704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d493c0a-f233-4c92-a16c-db1dbf465811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:08.231356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d493c0a-f233-4c92-a16c-db1dbf465811 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:08.253384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 695/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:10.569297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c4b9-453a-42da-a303-d8e71a99df9a None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:10.569943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c4b9-453a-42da-a303-d8e71a99df9a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:10.569943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533c4b9-453a-42da-a303-d8e71a99df9a None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:10.571151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 682/1377] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:10.576644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e592-81a5-4bf3-a49c-5a6d89897e35 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:10.577130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e592-81a5-4bf3-a49c-5a6d89897e35 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:10.577252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e592-81a5-4bf3-a49c-5a6d89897e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:10.659768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1961e592-81a5-4bf3-a49c-5a6d89897e35 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:10.661016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1961e592-81a5-4bf3-a49c-5a6d89897e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:10.668461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:10.800930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 696/1378] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:11.111025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533c4b9-453a-42da-a303-d8e71a99df9a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:11.113260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c533c4b9-453a-42da-a303-d8e71a99df9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:11.340395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533c4b9-453a-42da-a303-d8e71a99df9a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:11.353607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:11.559434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d6f7-4562-4a5f-b721-4d0631d74fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:11.560197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d6f7-4562-4a5f-b721-4d0631d74fc2 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:11.560487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d6f7-4562-4a5f-b721-4d0631d74fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:11.560791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d6f7-4562-4a5f-b721-4d0631d74fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:11.563026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2dc3d6f7-4562-4a5f-b721-4d0631d74fc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:11.737463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d6f7-4562-4a5f-b721-4d0631d74fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:11.739733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d6f7-4562-4a5f-b721-4d0631d74fc2 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:11.765425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 683/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:14.663119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688f4c-22e0-4f10-b3c9-3954a03fac94 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:14.663119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688f4c-22e0-4f10-b3c9-3954a03fac94 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:14.663119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688f4c-22e0-4f10-b3c9-3954a03fac94 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:14.669410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 697/1380] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:14.678890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98053-6367-4081-b336-e951e3ab079a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:14.679437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98053-6367-4081-b336-e951e3ab079a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:14.679699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98053-6367-4081-b336-e951e3ab079a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:14.695968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:14.810856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-afa98053-6367-4081-b336-e951e3ab079a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:14.812968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-afa98053-6367-4081-b336-e951e3ab079a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:14.974958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 684/1381] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:18:15.317096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688f4c-22e0-4f10-b3c9-3954a03fac94 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:15.318650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7e688f4c-22e0-4f10-b3c9-3954a03fac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:15.511409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:15.526354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688f4c-22e0-4f10-b3c9-3954a03fac94 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:15.718275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937a0d-1a80-47f0-b9b8-4264b6c9101b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:15.718923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937a0d-1a80-47f0-b9b8-4264b6c9101b service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:15.719485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937a0d-1a80-47f0-b9b8-4264b6c9101b service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:15.719760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937a0d-1a80-47f0-b9b8-4264b6c9101b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:15.722053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f7937a0d-1a80-47f0-b9b8-4264b6c9101b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:15.825137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937a0d-1a80-47f0-b9b8-4264b6c9101b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:15.827405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937a0d-1a80-47f0-b9b8-4264b6c9101b service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:15.842643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:15.863316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 698/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:18:18.795195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea10444-cbff-496e-85a7-b11d6f3515f9 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:18.795971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea10444-cbff-496e-85a7-b11d6f3515f9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:18.795971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea10444-cbff-496e-85a7-b11d6f3515f9 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:18.797455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 685/1383] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:18.805694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782d3aa-9f04-4b64-a09b-a0fd22ce4c3e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:18.806740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782d3aa-9f04-4b64-a09b-a0fd22ce4c3e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:18.806740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782d3aa-9f04-4b64-a09b-a0fd22ce4c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:18.934392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6782d3aa-9f04-4b64-a09b-a0fd22ce4c3e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:18.936453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6782d3aa-9f04-4b64-a09b-a0fd22ce4c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:19.135825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 699/1384] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:19.617872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea10444-cbff-496e-85a7-b11d6f3515f9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:19.619443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ea10444-cbff-496e-85a7-b11d6f3515f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:19.799800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:19.937849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea10444-cbff-496e-85a7-b11d6f3515f9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:20.156973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3760-b8f3-4e2d-a7c3-ac6fbcd28241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:20.157991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3760-b8f3-4e2d-a7c3-ac6fbcd28241 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:20.158583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3760-b8f3-4e2d-a7c3-ac6fbcd28241 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:20.158961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3760-b8f3-4e2d-a7c3-ac6fbcd28241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:20.161679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e54c3760-b8f3-4e2d-a7c3-ac6fbcd28241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:20.233479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:20.281738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3760-b8f3-4e2d-a7c3-ac6fbcd28241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:20.283688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3760-b8f3-4e2d-a7c3-ac6fbcd28241 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:20.316533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 686/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:22.507816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e2807-c320-4aad-8a3d-98f2a15848c7 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:22.508486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e2807-c320-4aad-8a3d-98f2a15848c7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:22.508486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e2807-c320-4aad-8a3d-98f2a15848c7 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:22.509807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 700/1386] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:18:22.516272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94a90-c5a2-481c-a7bb-1b1756bc435d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:22.516912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94a90-c5a2-481c-a7bb-1b1756bc435d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:22.516912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94a90-c5a2-481c-a7bb-1b1756bc435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:22.625091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-47f94a90-c5a2-481c-a7bb-1b1756bc435d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:22.626255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-47f94a90-c5a2-481c-a7bb-1b1756bc435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:22.778902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 687/1387] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:18:23.097478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e2807-c320-4aad-8a3d-98f2a15848c7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:23.099405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-052e2807-c320-4aad-8a3d-98f2a15848c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:23.202526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:23.287364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e2807-c320-4aad-8a3d-98f2a15848c7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:23.412881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc01b3-7700-4eea-b4cc-031b32c92b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:23.413291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc01b3-7700-4eea-b4cc-031b32c92b94 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:23.413567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc01b3-7700-4eea-b4cc-031b32c92b94 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:23.413836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc01b3-7700-4eea-b4cc-031b32c92b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:23.415458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-41bc01b3-7700-4eea-b4cc-031b32c92b94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:23.457292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:23.511600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc01b3-7700-4eea-b4cc-031b32c92b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:23.513254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc01b3-7700-4eea-b4cc-031b32c92b94 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:23.535512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 701/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:24.763750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b8306-9a2d-480b-98cd-9eec3b0fa2be None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:24.764362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b8306-9a2d-480b-98cd-9eec3b0fa2be None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:24.766107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b8306-9a2d-480b-98cd-9eec3b0fa2be None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:24.772358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 688/1389] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:24.777097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67989-9a91-42f7-9a48-6007dca8c934 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:24.777695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67989-9a91-42f7-9a48-6007dca8c934 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:24.778171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67989-9a91-42f7-9a48-6007dca8c934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:24.870058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-3fe67989-9a91-42f7-9a48-6007dca8c934 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:24.871284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3fe67989-9a91-42f7-9a48-6007dca8c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:25.016846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 702/1390] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:25.343006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a65b-5c11-44f2-9968-238116f84172 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:25.343423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a65b-5c11-44f2-9968-238116f84172 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:25.343635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a65b-5c11-44f2-9968-238116f84172 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:25.345173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 689/1391] 10.222.0.71 () {54 vars in 961 bytes} [Fri Sep 2 21:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:25.351443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ebc2-0af0-41ed-8b56-de9e6635d344 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:25.351729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ebc2-0af0-41ed-8b56-de9e6635d344 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:25.352002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ebc2-0af0-41ed-8b56-de9e6635d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:25.370194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:25.451715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b261ebc2-0af0-41ed-8b56-de9e6635d344 None None] MFA Rules not processed for user `36f0ee202c7946db8c77e1048d092fde`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:25.452997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b261ebc2-0af0-41ed-8b56-de9e6635d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:25.554670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 703/1392] 10.222.0.71 () {58 vars in 1058 bytes} [Fri Sep 2 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:25.566021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883a65b-5c11-44f2-9968-238116f84172 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:25.567573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c883a65b-5c11-44f2-9968-238116f84172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:25.603783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:25.718077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883a65b-5c11-44f2-9968-238116f84172 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:25.831653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:25.832564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:25.832564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:25.832819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:25.834615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:25.941867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:25.957488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff0f5-e78f-40f4-a2ab-4386f652144c None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:25.960911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff0f5-e78f-40f4-a2ab-4386f652144c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:25.960911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff0f5-e78f-40f4-a2ab-4386f652144c None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:25.960911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 704/1393] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:25.968051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5645-c2ba-4c99-86ac-d0f4f02d5b59 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:25.969003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5645-c2ba-4c99-86ac-d0f4f02d5b59 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:25.969765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5645-c2ba-4c99-86ac-d0f4f02d5b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:25.989637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:25.998973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:26.031749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 690/1394] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:26.072597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e8cd5645-c2ba-4c99-86ac-d0f4f02d5b59 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:26.073921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e8cd5645-c2ba-4c99-86ac-d0f4f02d5b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:26.138360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:26.191089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 705/1395] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:26.499348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:26.500753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:26.630539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622adc7-2625-4217-8032-8b338b17eda4 service glance] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:26.748185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:26.798155 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416103-59e5-47a2-b920-45c01bae4600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:26.799053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416103-59e5-47a2-b920-45c01bae4600 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:26.799348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416103-59e5-47a2-b920-45c01bae4600 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:26.799750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416103-59e5-47a2-b920-45c01bae4600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:26.801616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2d416103-59e5-47a2-b920-45c01bae4600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:26.927928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416103-59e5-47a2-b920-45c01bae4600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:26.929657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416103-59e5-47a2-b920-45c01bae4600 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:26.951929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 691/1396] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:27.114543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79369b-a889-4d22-ab44-00db4624ac70 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:27.120273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79369b-a889-4d22-ab44-00db4624ac70 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:27.120273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79369b-a889-4d22-ab44-00db4624ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:27.222074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-eb79369b-a889-4d22-ab44-00db4624ac70 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:27.223534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-eb79369b-a889-4d22-ab44-00db4624ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:27.341426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 706/1397] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:18:27.397865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fbf2-5f9e-43c2-b89a-dfa401aae4cd None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:27.398178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fbf2-5f9e-43c2-b89a-dfa401aae4cd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:27.398420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fbf2-5f9e-43c2-b89a-dfa401aae4cd None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:27.399873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 692/1398] 10.222.0.71 () {54 vars in 943 bytes} [Fri Sep 2 21:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:27.408299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05032a02-adbf-48ab-83fc-e8ef0bee62b1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:27.408622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05032a02-adbf-48ab-83fc-e8ef0bee62b1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:27.409021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05032a02-adbf-48ab-83fc-e8ef0bee62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:27.482186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:27.507285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-05032a02-adbf-48ab-83fc-e8ef0bee62b1 None None] MFA Rules not processed for user `27594eb14cf742ce8bcf21cdb8db5ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:27.508545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-05032a02-adbf-48ab-83fc-e8ef0bee62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:27.644987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 707/1399] 10.222.0.71 () {58 vars in 1040 bytes} [Fri Sep 2 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:27.655402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fbf2-5f9e-43c2-b89a-dfa401aae4cd None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:27.657083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8416fbf2-5f9e-43c2-b89a-dfa401aae4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:27.774949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:27.836241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fbf2-5f9e-43c2-b89a-dfa401aae4cd None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:27.975559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a4a15-06e3-4394-b7fc-b0aa81a34ff1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:27.976239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4a15-06e3-4394-b7fc-b0aa81a34ff1 service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:27.976435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4a15-06e3-4394-b7fc-b0aa81a34ff1 service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:27.976704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4a15-06e3-4394-b7fc-b0aa81a34ff1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:27.978463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7b0a4a15-06e3-4394-b7fc-b0aa81a34ff1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:28.069617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:28.082069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a4a15-06e3-4394-b7fc-b0aa81a34ff1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:28.083783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a4a15-06e3-4394-b7fc-b0aa81a34ff1 service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:28.093929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 693/1400] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:18:29.336271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b0f1-e4b2-4535-be13-c3455864dafa None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:29.337113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b0f1-e4b2-4535-be13-c3455864dafa None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:29.337289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b0f1-e4b2-4535-be13-c3455864dafa None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:29.338853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 708/1401] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:29.345746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1adab7-78cf-4eed-b425-65fbd80272e2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:29.347033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1adab7-78cf-4eed-b425-65fbd80272e2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:29.347326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1adab7-78cf-4eed-b425-65fbd80272e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:29.473974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0e1adab7-78cf-4eed-b425-65fbd80272e2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:29.476634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0e1adab7-78cf-4eed-b425-65fbd80272e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:29.704119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 694/1402] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:30.177905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b0f1-e4b2-4535-be13-c3455864dafa None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:30.180667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f514b0f1-e4b2-4535-be13-c3455864dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:30.394739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:30.461957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b0f1-e4b2-4535-be13-c3455864dafa None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:30.619387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dc19c-e53e-45da-9cd2-994ffb63bd4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:30.620126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dc19c-e53e-45da-9cd2-994ffb63bd4a service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:30.620485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dc19c-e53e-45da-9cd2-994ffb63bd4a service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:30.620857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dc19c-e53e-45da-9cd2-994ffb63bd4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:30.622702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0a3dc19c-e53e-45da-9cd2-994ffb63bd4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:30.730033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:30.768827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dc19c-e53e-45da-9cd2-994ffb63bd4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:30.772288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dc19c-e53e-45da-9cd2-994ffb63bd4a service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:30.795777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 709/1403] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:35.083351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe9bf6-560a-44cd-8cfa-0b0305434bec None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:35.084163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe9bf6-560a-44cd-8cfa-0b0305434bec None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:35.084163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe9bf6-560a-44cd-8cfa-0b0305434bec None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:35.085956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 695/1404] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:35.099736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44440a70-5ed6-4e2e-93be-51cd0f0349a4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:35.100586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44440a70-5ed6-4e2e-93be-51cd0f0349a4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:35.100586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44440a70-5ed6-4e2e-93be-51cd0f0349a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:35.229554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-44440a70-5ed6-4e2e-93be-51cd0f0349a4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:35.231596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-44440a70-5ed6-4e2e-93be-51cd0f0349a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:35.421446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 710/1405] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:18:35.766262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe9bf6-560a-44cd-8cfa-0b0305434bec None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:35.769053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fdbe9bf6-560a-44cd-8cfa-0b0305434bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:35.931589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:36.140804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe9bf6-560a-44cd-8cfa-0b0305434bec None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:36.203819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6a752-f487-490d-9bb5-a804d00bd414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:36.206027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a752-f487-490d-9bb5-a804d00bd414 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:36.206833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a752-f487-490d-9bb5-a804d00bd414 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:36.207352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a752-f487-490d-9bb5-a804d00bd414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:36.210431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-84d6a752-f487-490d-9bb5-a804d00bd414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:36.269334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:36.344805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6a752-f487-490d-9bb5-a804d00bd414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:36.346635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6a752-f487-490d-9bb5-a804d00bd414 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:36.370491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 696/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:39.192900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e985a-012e-4f4b-a116-fa4cc7591cc4 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:39.193483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e985a-012e-4f4b-a116-fa4cc7591cc4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:39.193483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e985a-012e-4f4b-a116-fa4cc7591cc4 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:39.195262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 711/1407] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:39.200847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd877f9e-2b26-4611-a8e0-294448105616 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:39.209518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd877f9e-2b26-4611-a8e0-294448105616 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:39.209518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd877f9e-2b26-4611-a8e0-294448105616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:39.291358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-cd877f9e-2b26-4611-a8e0-294448105616 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:39.292776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-cd877f9e-2b26-4611-a8e0-294448105616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:39.452969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 697/1408] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:39.810296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e985a-012e-4f4b-a116-fa4cc7591cc4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:39.812546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-cd4e985a-012e-4f4b-a116-fa4cc7591cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:39.921847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:40.081172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e985a-012e-4f4b-a116-fa4cc7591cc4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:40.236360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90400ea4-9e87-4dc9-83c7-f33297b264f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:40.306673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400ea4-9e87-4dc9-83c7-f33297b264f1 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:40.306673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400ea4-9e87-4dc9-83c7-f33297b264f1 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:40.306673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400ea4-9e87-4dc9-83c7-f33297b264f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:40.306673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-90400ea4-9e87-4dc9-83c7-f33297b264f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:40.347023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90400ea4-9e87-4dc9-83c7-f33297b264f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:40.349031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90400ea4-9e87-4dc9-83c7-f33297b264f1 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:40.371003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 712/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:40.669182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:49.447728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:50.794482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=41 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:55.311638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a992-4efe-4c66-9057-684ef80c4b50 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:55.312276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a992-4efe-4c66-9057-684ef80c4b50 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:55.312276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a992-4efe-4c66-9057-684ef80c4b50 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:55.314408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 698/1410] 10.222.0.71 () {54 vars in 918 bytes} [Fri Sep 2 21:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:55.327010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab10539-cd89-43a8-92f9-41e4f1e551a6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:55.327597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab10539-cd89-43a8-92f9-41e4f1e551a6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:55.327894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab10539-cd89-43a8-92f9-41e4f1e551a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:55.433039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6ab10539-cd89-43a8-92f9-41e4f1e551a6 None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:55.434194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6ab10539-cd89-43a8-92f9-41e4f1e551a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:55.567095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 713/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Fri Sep 2 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:55.584149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5236a3-33bc-4310-bec2-3ec328f9b539 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:55.584500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5236a3-33bc-4310-bec2-3ec328f9b539 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:55.584804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5236a3-33bc-4310-bec2-3ec328f9b539 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:55.586922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 699/1412] 10.222.0.71 () {54 vars in 918 bytes} [Fri Sep 2 21:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:55.592881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c806-a1e3-4492-b285-42cbae317fe0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:55.593235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c806-a1e3-4492-b285-42cbae317fe0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:55.593515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c806-a1e3-4492-b285-42cbae317fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:55.678905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:55.682799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6484c806-a1e3-4492-b285-42cbae317fe0 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:55.684091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6484c806-a1e3-4492-b285-42cbae317fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:55.823003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 714/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Fri Sep 2 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:58.482038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2a08-dece-4cf6-a7f1-50a1fa0cf130 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:58.483573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2a08-dece-4cf6-a7f1-50a1fa0cf130 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:58.483573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2a08-dece-4cf6-a7f1-50a1fa0cf130 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:58.486249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:18:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:58.494921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c37d-7ccc-4d16-869b-0db097daa82a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:58.495501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c37d-7ccc-4d16-869b-0db097daa82a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:58.495850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c37d-7ccc-4d16-869b-0db097daa82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:58.601632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b9d9c37d-7ccc-4d16-869b-0db097daa82a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:58.602986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b9d9c37d-7ccc-4d16-869b-0db097daa82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:58.683078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:58.734260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:18:59.037726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2a08-dece-4cf6-a7f1-50a1fa0cf130 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:59.039249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-307d2a08-dece-4cf6-a7f1-50a1fa0cf130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:59.212063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2a08-dece-4cf6-a7f1-50a1fa0cf130 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:59.301897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:59.355080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384dc62-0375-4375-a2a9-eb2604feb2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:59.355706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384dc62-0375-4375-a2a9-eb2604feb2eb service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:59.356034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384dc62-0375-4375-a2a9-eb2604feb2eb service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:59.356562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384dc62-0375-4375-a2a9-eb2604feb2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:59.358741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5384dc62-0375-4375-a2a9-eb2604feb2eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:59.463499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384dc62-0375-4375-a2a9-eb2604feb2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:59.465370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384dc62-0375-4375-a2a9-eb2604feb2eb service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:59.499876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 701/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:00.563313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d2d73-3899-4c85-a9f6-7f68cf16f081 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:00.564464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d2d73-3899-4c85-a9f6-7f68cf16f081 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:00.564464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d2d73-3899-4c85-a9f6-7f68cf16f081 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:00.566846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:19:00.574242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b14f2-a3cd-43fa-91e3-dfd88bb9993d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:00.574964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b14f2-a3cd-43fa-91e3-dfd88bb9993d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:00.574964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b14f2-a3cd-43fa-91e3-dfd88bb9993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:00.680971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-480b14f2-a3cd-43fa-91e3-dfd88bb9993d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:00.682252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-480b14f2-a3cd-43fa-91e3-dfd88bb9993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:00.722232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:00.827137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:19:00.987188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d2d73-3899-4c85-a9f6-7f68cf16f081 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:00.988716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-559d2d73-3899-4c85-a9f6-7f68cf16f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:01.174010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d2d73-3899-4c85-a9f6-7f68cf16f081 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:01.224263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:01.333536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c125e9-d289-41e1-b493-d3cdb4f720fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:01.334163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c125e9-d289-41e1-b493-d3cdb4f720fa service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:01.334436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c125e9-d289-41e1-b493-d3cdb4f720fa service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:01.334712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c125e9-d289-41e1-b493-d3cdb4f720fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:01.336358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-06c125e9-d289-41e1-b493-d3cdb4f720fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:01.438778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c125e9-d289-41e1-b493-d3cdb4f720fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:01.440822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c125e9-d289-41e1-b493-d3cdb4f720fa service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:01.462204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 717/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:19:02.429994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075356-07c1-4185-bda1-e7eb8344b4c0 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:02.430578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075356-07c1-4185-bda1-e7eb8344b4c0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:02.430803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075356-07c1-4185-bda1-e7eb8344b4c0 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:02.432230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:02.437539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d3ee-4fc2-47f3-9d63-18a52975b03a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:02.438697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d3ee-4fc2-47f3-9d63-18a52975b03a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:02.438697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d3ee-4fc2-47f3-9d63-18a52975b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:02.524376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:02.552507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7e87d3ee-4fc2-47f3-9d63-18a52975b03a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:02.553757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7e87d3ee-4fc2-47f3-9d63-18a52975b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:02.690129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:02.850536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7075356-07c1-4185-bda1-e7eb8344b4c0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:02.852160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b7075356-07c1-4185-bda1-e7eb8344b4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:03.045911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7075356-07c1-4185-bda1-e7eb8344b4c0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:03.067405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:03.253210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533ee9c-0fdb-4568-a2ae-5c52d7109a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:03.253860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ee9c-0fdb-4568-a2ae-5c52d7109a35 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:03.254173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ee9c-0fdb-4568-a2ae-5c52d7109a35 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:03.254500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ee9c-0fdb-4568-a2ae-5c52d7109a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:03.256147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b533ee9c-0fdb-4568-a2ae-5c52d7109a35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:03.388173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533ee9c-0fdb-4568-a2ae-5c52d7109a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:03.392092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533ee9c-0fdb-4568-a2ae-5c52d7109a35 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:03.423179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 704/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:04.443609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc63bc-68ba-4d3c-bbd6-61d6b0137e63 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:04.444523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc63bc-68ba-4d3c-bbd6-61d6b0137e63 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:04.444523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc63bc-68ba-4d3c-bbd6-61d6b0137e63 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:04.446909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:04.454596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5278-e1c4-4481-933e-41adbef5105e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:04.454596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5278-e1c4-4481-933e-41adbef5105e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:04.455728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5278-e1c4-4481-933e-41adbef5105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:04.486583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:04.584896 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c4db5278-e1c4-4481-933e-41adbef5105e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:04.586257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c4db5278-e1c4-4481-933e-41adbef5105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:04.765800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:04.974930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc63bc-68ba-4d3c-bbd6-61d6b0137e63 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:04.978118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-57cc63bc-68ba-4d3c-bbd6-61d6b0137e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:05.199103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:05.261364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc63bc-68ba-4d3c-bbd6-61d6b0137e63 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:05.470868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271d9c-e540-46e7-b2d0-31e2e4d7c0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:05.471621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d9c-e540-46e7-b2d0-31e2e4d7c0d9 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:05.471993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d9c-e540-46e7-b2d0-31e2e4d7c0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:05.472340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d9c-e540-46e7-b2d0-31e2e4d7c0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:05.474578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3d271d9c-e540-46e7-b2d0-31e2e4d7c0d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:05.604079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:05.624833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271d9c-e540-46e7-b2d0-31e2e4d7c0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:05.630569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271d9c-e540-46e7-b2d0-31e2e4d7c0d9 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:05.666801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 720/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:06.793384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed7f54-3a73-4555-85e2-67255ed2c470 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:06.794183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed7f54-3a73-4555-85e2-67255ed2c470 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:06.794183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed7f54-3a73-4555-85e2-67255ed2c470 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:06.796525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:06.804563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648209-0180-466a-83d1-35d9495adcca None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:06.805239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648209-0180-466a-83d1-35d9495adcca None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:06.805239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648209-0180-466a-83d1-35d9495adcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:06.946946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0a648209-0180-466a-83d1-35d9495adcca None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:06.948570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0a648209-0180-466a-83d1-35d9495adcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:07.121210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:07.311554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed7f54-3a73-4555-85e2-67255ed2c470 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:07.314233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1bed7f54-3a73-4555-85e2-67255ed2c470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:07.424940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:07.519773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed7f54-3a73-4555-85e2-67255ed2c470 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:07.700647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b765a-74fe-4ce2-9297-2e5e9d1de210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:07.704712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b765a-74fe-4ce2-9297-2e5e9d1de210 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:07.704712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b765a-74fe-4ce2-9297-2e5e9d1de210 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:07.704712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b765a-74fe-4ce2-9297-2e5e9d1de210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:07.705811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-574b765a-74fe-4ce2-9297-2e5e9d1de210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:07.794901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:07.866188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b765a-74fe-4ce2-9297-2e5e9d1de210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:07.869282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b765a-74fe-4ce2-9297-2e5e9d1de210 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:07.907360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 707/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:08.842861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3243cde-df7a-4350-bc65-de56f7464a53 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:08.844070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3243cde-df7a-4350-bc65-de56f7464a53 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:08.844070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3243cde-df7a-4350-bc65-de56f7464a53 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:08.845854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:08.851350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd18b-4990-4f18-a201-92557da20c1c None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:08.852073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd18b-4990-4f18-a201-92557da20c1c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:08.852073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd18b-4990-4f18-a201-92557da20c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:08.956491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e64dd18b-4990-4f18-a201-92557da20c1c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:08.959941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e64dd18b-4990-4f18-a201-92557da20c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:09.120915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:09.309714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3243cde-df7a-4350-bc65-de56f7464a53 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:09.311316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d3243cde-df7a-4350-bc65-de56f7464a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:09.373507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:09.491832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3243cde-df7a-4350-bc65-de56f7464a53 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:09.671177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2941-ec81-4eae-9816-e730e2301db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:09.671725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2941-ec81-4eae-9816-e730e2301db1 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:09.675164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2941-ec81-4eae-9816-e730e2301db1 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:09.675164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2941-ec81-4eae-9816-e730e2301db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:09.675164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-25fd2941-ec81-4eae-9816-e730e2301db1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:09.682754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:09.807842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd2941-ec81-4eae-9816-e730e2301db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:09.809545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd2941-ec81-4eae-9816-e730e2301db1 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:09.837982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 723/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:10.857796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93691-a28c-47e8-a03e-eed5d64d42a6 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:10.858604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93691-a28c-47e8-a03e-eed5d64d42a6 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:10.858604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93691-a28c-47e8-a03e-eed5d64d42a6 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:10.859765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:10.865488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc980-5a0f-4640-9dce-046b1067339e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:10.865984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc980-5a0f-4640-9dce-046b1067339e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:10.865984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc980-5a0f-4640-9dce-046b1067339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:10.963171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-8f1fc980-5a0f-4640-9dce-046b1067339e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:10.965355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8f1fc980-5a0f-4640-9dce-046b1067339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:11.058678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:11.095530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:19:11.260085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93691-a28c-47e8-a03e-eed5d64d42a6 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:11.262039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2aa93691-a28c-47e8-a03e-eed5d64d42a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:11.286428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:11.453634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93691-a28c-47e8-a03e-eed5d64d42a6 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:11.591815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:11.625501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d591a4-d663-4dc1-973b-ed7d53c33b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:11.626187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d591a4-d663-4dc1-973b-ed7d53c33b5a service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:11.626606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d591a4-d663-4dc1-973b-ed7d53c33b5a service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:11.626929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d591a4-d663-4dc1-973b-ed7d53c33b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:11.629062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-76d591a4-d663-4dc1-973b-ed7d53c33b5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:11.747715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d591a4-d663-4dc1-973b-ed7d53c33b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:11.749381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d591a4-d663-4dc1-973b-ed7d53c33b5a service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:11.772944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 710/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:19:12.739872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905902-cf8c-4442-bf9b-a24c92c843a9 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:12.740797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905902-cf8c-4442-bf9b-a24c92c843a9 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:12.740797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905902-cf8c-4442-bf9b-a24c92c843a9 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:12.742329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:12.748433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc7a7-3995-4988-a569-4f14b6d54f39 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:12.749044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc7a7-3995-4988-a569-4f14b6d54f39 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:12.749044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc7a7-3995-4988-a569-4f14b6d54f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:12.877540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c2cbc7a7-3995-4988-a569-4f14b6d54f39 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:12.879651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c2cbc7a7-3995-4988-a569-4f14b6d54f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:12.948444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:13.077744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:19:13.190239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0905902-cf8c-4442-bf9b-a24c92c843a9 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:13.191896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d0905902-cf8c-4442-bf9b-a24c92c843a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:13.359918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0905902-cf8c-4442-bf9b-a24c92c843a9 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:13.432488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:13.514449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9db7f2-428f-4db8-8f2a-d8e59788e5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:13.515262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db7f2-428f-4db8-8f2a-d8e59788e5f3 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:13.516035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db7f2-428f-4db8-8f2a-d8e59788e5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:13.516464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db7f2-428f-4db8-8f2a-d8e59788e5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:13.518262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1f9db7f2-428f-4db8-8f2a-d8e59788e5f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:13.646090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9db7f2-428f-4db8-8f2a-d8e59788e5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:13.647781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9db7f2-428f-4db8-8f2a-d8e59788e5f3 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:13.669230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 726/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:19:14.697210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545310-fbd3-402e-adb4-7b913416eaa7 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:14.697952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545310-fbd3-402e-adb4-7b913416eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:14.697952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545310-fbd3-402e-adb4-7b913416eaa7 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:14.699167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:14.706203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9b9bb-c6af-4fc0-9766-99c48e66f76d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:14.707214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9b9bb-c6af-4fc0-9766-99c48e66f76d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:14.707214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9b9bb-c6af-4fc0-9766-99c48e66f76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:14.813224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-31d9b9bb-c6af-4fc0-9766-99c48e66f76d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:14.814470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-31d9b9bb-c6af-4fc0-9766-99c48e66f76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:14.816620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:14.933505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:15.093607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa545310-fbd3-402e-adb4-7b913416eaa7 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:15.095309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-aa545310-fbd3-402e-adb4-7b913416eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:15.303521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa545310-fbd3-402e-adb4-7b913416eaa7 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:15.341066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:15.452427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3007eb1-3628-4474-994f-6773be5c465d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:15.453080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3007eb1-3628-4474-994f-6773be5c465d service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:15.453363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3007eb1-3628-4474-994f-6773be5c465d service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:15.453639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3007eb1-3628-4474-994f-6773be5c465d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:15.455301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b3007eb1-3628-4474-994f-6773be5c465d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:15.574568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3007eb1-3628-4474-994f-6773be5c465d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:15.577225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3007eb1-3628-4474-994f-6773be5c465d service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:15.613961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 713/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:17.565552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57342b-eeb0-483e-a80f-f0440d5a1edf None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:17.566131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57342b-eeb0-483e-a80f-f0440d5a1edf None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:17.566131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57342b-eeb0-483e-a80f-f0440d5a1edf None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:17.567471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:17.573596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7fdb1-aeb3-4193-8a18-fbdf33c33c6f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:17.574110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7fdb1-aeb3-4193-8a18-fbdf33c33c6f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:17.574219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7fdb1-aeb3-4193-8a18-fbdf33c33c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:17.622423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:17.658125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-08d7fdb1-aeb3-4193-8a18-fbdf33c33c6f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:17.658125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-08d7fdb1-aeb3-4193-8a18-fbdf33c33c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:17.778698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:18.078401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57342b-eeb0-483e-a80f-f0440d5a1edf None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:18.079982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4a57342b-eeb0-483e-a80f-f0440d5a1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:18.190477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57342b-eeb0-483e-a80f-f0440d5a1edf None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:18.224571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:18.272826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a5c0d-fe72-421b-983b-f9a4ea2b2f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:18.273454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a5c0d-fe72-421b-983b-f9a4ea2b2f5c service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:18.273728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a5c0d-fe72-421b-983b-f9a4ea2b2f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:18.274003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a5c0d-fe72-421b-983b-f9a4ea2b2f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:18.275665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c55a5c0d-fe72-421b-983b-f9a4ea2b2f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:18.403290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a5c0d-fe72-421b-983b-f9a4ea2b2f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:18.405137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a5c0d-fe72-421b-983b-f9a4ea2b2f5c service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:18.426207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 729/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:20.768949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7f7bb-5532-4b59-95e3-f051d9dd6b3c None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:20.769545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7f7bb-5532-4b59-95e3-f051d9dd6b3c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:20.769545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7f7bb-5532-4b59-95e3-f051d9dd6b3c None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:20.770856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:20.776757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc76f0-b842-4d67-8957-22ec2ba3a25a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:20.777484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc76f0-b842-4d67-8957-22ec2ba3a25a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:20.777484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc76f0-b842-4d67-8957-22ec2ba3a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:20.854286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2bdc76f0-b842-4d67-8957-22ec2ba3a25a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:20.855519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2bdc76f0-b842-4d67-8957-22ec2ba3a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:20.870513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:20.973775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:21.278420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7f7bb-5532-4b59-95e3-f051d9dd6b3c None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:21.280011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-79a7f7bb-5532-4b59-95e3-f051d9dd6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:21.407290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7f7bb-5532-4b59-95e3-f051d9dd6b3c None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:21.424008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:21.496823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cf5ba-2187-411f-9421-269d6d1ab43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:21.497442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf5ba-2187-411f-9421-269d6d1ab43a service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:21.497721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf5ba-2187-411f-9421-269d6d1ab43a service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:21.497995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cf5ba-2187-411f-9421-269d6d1ab43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:21.500682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ab6cf5ba-2187-411f-9421-269d6d1ab43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:21.628315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cf5ba-2187-411f-9421-269d6d1ab43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:21.629828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cf5ba-2187-411f-9421-269d6d1ab43a service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:21.651390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 716/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:24.181940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcbc98-f62b-44de-8e8c-94b78c10dca1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:24.182508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcbc98-f62b-44de-8e8c-94b78c10dca1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:24.182508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcbc98-f62b-44de-8e8c-94b78c10dca1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:24.183727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:24.190476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c848-d4f4-43f5-a01d-d7ec5ec98758 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:24.191221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c848-d4f4-43f5-a01d-d7ec5ec98758 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:24.191992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c848-d4f4-43f5-a01d-d7ec5ec98758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:24.245676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:24.266989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7853c848-d4f4-43f5-a01d-d7ec5ec98758 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:24.268233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7853c848-d4f4-43f5-a01d-d7ec5ec98758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:24.373383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:24.661689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcbc98-f62b-44de-8e8c-94b78c10dca1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:24.663243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4fbcbc98-f62b-44de-8e8c-94b78c10dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:24.786181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcbc98-f62b-44de-8e8c-94b78c10dca1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:24.829319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:24.867415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc879189-0420-40ee-aa9d-387e8f9f33c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:24.868023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879189-0420-40ee-aa9d-387e8f9f33c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:24.868291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879189-0420-40ee-aa9d-387e8f9f33c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:24.868559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879189-0420-40ee-aa9d-387e8f9f33c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:24.870263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-bc879189-0420-40ee-aa9d-387e8f9f33c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:25.002538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc879189-0420-40ee-aa9d-387e8f9f33c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:25.004039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc879189-0420-40ee-aa9d-387e8f9f33c3 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:25.025041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 732/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:27.220936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b437-4485-4e89-8ad4-bad4ff91901d None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:27.221509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b437-4485-4e89-8ad4-bad4ff91901d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:27.221509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b437-4485-4e89-8ad4-bad4ff91901d None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:27.223118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:27.229064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3878b87-effd-4375-af3a-8153b7eb596c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:27.230179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3878b87-effd-4375-af3a-8153b7eb596c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:27.230179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3878b87-effd-4375-af3a-8153b7eb596c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:27.312680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f3878b87-effd-4375-af3a-8153b7eb596c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:27.314048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f3878b87-effd-4375-af3a-8153b7eb596c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:27.337825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:27.426263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:19:27.739404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b437-4485-4e89-8ad4-bad4ff91901d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:27.741693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1e30b437-4485-4e89-8ad4-bad4ff91901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:27.900465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b437-4485-4e89-8ad4-bad4ff91901d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:27.929524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:27.996042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439165b-e297-4d62-b976-6f713e8d2441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:27.996756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439165b-e297-4d62-b976-6f713e8d2441 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:27.997124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439165b-e297-4d62-b976-6f713e8d2441 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:27.997513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439165b-e297-4d62-b976-6f713e8d2441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:27.999306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9439165b-e297-4d62-b976-6f713e8d2441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:28.148551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439165b-e297-4d62-b976-6f713e8d2441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:28.150531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439165b-e297-4d62-b976-6f713e8d2441 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:28.176346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 719/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:30.464568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f2f81-7eb7-48f4-9117-f3f98f84376d None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:30.465171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f2f81-7eb7-48f4-9117-f3f98f84376d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:30.465171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f2f81-7eb7-48f4-9117-f3f98f84376d None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:30.466525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:30.473818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e570b-4ffe-46b7-ba7e-1d5659ab64d5 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:30.474375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e570b-4ffe-46b7-ba7e-1d5659ab64d5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:30.474375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e570b-4ffe-46b7-ba7e-1d5659ab64d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:30.547248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:30.550780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-974e570b-4ffe-46b7-ba7e-1d5659ab64d5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:30.552606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-974e570b-4ffe-46b7-ba7e-1d5659ab64d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:30.687684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:30.982685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f2f81-7eb7-48f4-9117-f3f98f84376d None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:30.985425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-058f2f81-7eb7-48f4-9117-f3f98f84376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:31.098241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f2f81-7eb7-48f4-9117-f3f98f84376d None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:31.150051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:31.177982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960f7b9-f7c6-4a23-b547-9959696375f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:31.178605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960f7b9-f7c6-4a23-b547-9959696375f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:31.178884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960f7b9-f7c6-4a23-b547-9959696375f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:31.179159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960f7b9-f7c6-4a23-b547-9959696375f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:31.180826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8960f7b9-f7c6-4a23-b547-9959696375f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:31.299393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960f7b9-f7c6-4a23-b547-9959696375f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:31.300790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960f7b9-f7c6-4a23-b547-9959696375f4 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:31.319693 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 735/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:33.401585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3c28-ae16-495b-847d-de25e52a4a4a None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:33.402281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3c28-ae16-495b-847d-de25e52a4a4a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:33.402281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3c28-ae16-495b-847d-de25e52a4a4a None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:33.403500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:33.409234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf53e-31dd-406b-bc92-90e9489f06bd None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:33.409764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf53e-31dd-406b-bc92-90e9489f06bd None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:33.409764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf53e-31dd-406b-bc92-90e9489f06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:33.487519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e2abf53e-31dd-406b-bc92-90e9489f06bd None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:33.488771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e2abf53e-31dd-406b-bc92-90e9489f06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:33.523144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:33.597595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:33.893965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a3c28-ae16-495b-847d-de25e52a4a4a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:33.896668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9a7a3c28-ae16-495b-847d-de25e52a4a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:34.018972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a3c28-ae16-495b-847d-de25e52a4a4a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:34.049593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:34.100441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa857bce-2b1b-4ee9-9d9a-e391a6031e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:34.101087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa857bce-2b1b-4ee9-9d9a-e391a6031e7e service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:34.101368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa857bce-2b1b-4ee9-9d9a-e391a6031e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:34.101640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa857bce-2b1b-4ee9-9d9a-e391a6031e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:34.103301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fa857bce-2b1b-4ee9-9d9a-e391a6031e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:34.228570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa857bce-2b1b-4ee9-9d9a-e391a6031e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:34.230242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa857bce-2b1b-4ee9-9d9a-e391a6031e7e service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:34.252833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 722/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:36.444260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999038-3e2a-4d4f-b29c-22ad4d59f170 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:36.444904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999038-3e2a-4d4f-b29c-22ad4d59f170 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:36.444904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999038-3e2a-4d4f-b29c-22ad4d59f170 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:36.446233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:36.451776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7584e1e-c32e-480f-bf58-1ce57e69bb50 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:36.452290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7584e1e-c32e-480f-bf58-1ce57e69bb50 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:36.452493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7584e1e-c32e-480f-bf58-1ce57e69bb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:36.530959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b7584e1e-c32e-480f-bf58-1ce57e69bb50 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:36.532263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b7584e1e-c32e-480f-bf58-1ce57e69bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:36.541455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:36.644695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:36.946396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999038-3e2a-4d4f-b29c-22ad4d59f170 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:36.947941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-70999038-3e2a-4d4f-b29c-22ad4d59f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:37.083046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999038-3e2a-4d4f-b29c-22ad4d59f170 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:37.147300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:37.168694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925e7f1-d842-4d89-ad3b-ac3093064d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:37.169442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925e7f1-d842-4d89-ad3b-ac3093064d1e service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:37.169612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925e7f1-d842-4d89-ad3b-ac3093064d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:37.169883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925e7f1-d842-4d89-ad3b-ac3093064d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:37.172492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c925e7f1-d842-4d89-ad3b-ac3093064d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:37.291474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925e7f1-d842-4d89-ad3b-ac3093064d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:37.292956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925e7f1-d842-4d89-ad3b-ac3093064d1e service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:37.315217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 738/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:39.471643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c13baa-c4ec-47ca-88ce-e1caf0f66976 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:39.472330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c13baa-c4ec-47ca-88ce-e1caf0f66976 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:39.472330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c13baa-c4ec-47ca-88ce-e1caf0f66976 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:39.474217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:39.482205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bac1a-75cc-48f1-9f96-4afdfba41e4f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:39.483157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bac1a-75cc-48f1-9f96-4afdfba41e4f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:39.483157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bac1a-75cc-48f1-9f96-4afdfba41e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:39.562953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-002bac1a-75cc-48f1-9f96-4afdfba41e4f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:39.564203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-002bac1a-75cc-48f1-9f96-4afdfba41e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:39.612542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:39.685863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:19:39.974742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c13baa-c4ec-47ca-88ce-e1caf0f66976 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:39.976236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a3c13baa-c4ec-47ca-88ce-e1caf0f66976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:40.095633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c13baa-c4ec-47ca-88ce-e1caf0f66976 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:40.142145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:40.200199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117af6b-f295-4aed-b224-5f83256ef052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:40.201301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117af6b-f295-4aed-b224-5f83256ef052 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:40.202507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117af6b-f295-4aed-b224-5f83256ef052 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:40.202930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117af6b-f295-4aed-b224-5f83256ef052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:40.205916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1117af6b-f295-4aed-b224-5f83256ef052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:40.350214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117af6b-f295-4aed-b224-5f83256ef052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:40.351832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117af6b-f295-4aed-b224-5f83256ef052 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:40.374436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 725/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:42.478077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ab8f-adbd-4679-916b-c5f4d3c33a6b None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:42.478626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ab8f-adbd-4679-916b-c5f4d3c33a6b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:42.478752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ab8f-adbd-4679-916b-c5f4d3c33a6b None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:42.480018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:42.486188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801709-b988-446a-9f33-22a226b4ab6e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:42.486680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801709-b988-446a-9f33-22a226b4ab6e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:42.486775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801709-b988-446a-9f33-22a226b4ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:42.579285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-d6801709-b988-446a-9f33-22a226b4ab6e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:42.580559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d6801709-b988-446a-9f33-22a226b4ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:42.599780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:42.683000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:42.969953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ab8f-adbd-4679-916b-c5f4d3c33a6b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:42.971570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6574ab8f-adbd-4679-916b-c5f4d3c33a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:43.115235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ab8f-adbd-4679-916b-c5f4d3c33a6b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:43.193710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:43.201905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf4fc9-1aae-4c57-a5a1-1100b1e5884e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:43.201905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf4fc9-1aae-4c57-a5a1-1100b1e5884e service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:43.201905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf4fc9-1aae-4c57-a5a1-1100b1e5884e service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:43.203338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf4fc9-1aae-4c57-a5a1-1100b1e5884e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:43.203898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-52cf4fc9-1aae-4c57-a5a1-1100b1e5884e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:43.321634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf4fc9-1aae-4c57-a5a1-1100b1e5884e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:43.323131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf4fc9-1aae-4c57-a5a1-1100b1e5884e service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:43.341357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 741/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:45.333497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5881-a062-45ff-83c4-29f9dbf4ce58 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:45.334092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5881-a062-45ff-83c4-29f9dbf4ce58 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:45.334092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5881-a062-45ff-83c4-29f9dbf4ce58 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:45.335469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:19:45.341312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ae29-ba01-4725-be6d-d7068ae4f845 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:45.341823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ae29-ba01-4725-be6d-d7068ae4f845 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:45.341932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ae29-ba01-4725-be6d-d7068ae4f845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:45.415996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-af22ae29-ba01-4725-be6d-d7068ae4f845 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:19:45.417298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-af22ae29-ba01-4725-be6d-d7068ae4f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:45.473593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:45.533311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:19:45.819570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5881-a062-45ff-83c4-29f9dbf4ce58 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:19:45.821162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d96d5881-a062-45ff-83c4-29f9dbf4ce58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:45.941922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5881-a062-45ff-83c4-29f9dbf4ce58 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:19:46.000450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:46.039200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fb55b-47f3-4433-bf77-6bb55f984ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:19:46.039616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fb55b-47f3-4433-bf77-6bb55f984ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:19:46.039860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fb55b-47f3-4433-bf77-6bb55f984ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:19:46.040124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fb55b-47f3-4433-bf77-6bb55f984ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:19:46.041902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bd2fb55b-47f3-4433-bf77-6bb55f984ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:19:46.179247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fb55b-47f3-4433-bf77-6bb55f984ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:19:46.180698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fb55b-47f3-4433-bf77-6bb55f984ab9 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:19:46.200719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 728/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:19:55.531030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=22 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:56.198394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=66 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:06.767285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab3f5-c07f-4c39-8807-6ff268d99b4e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:06.767910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab3f5-c07f-4c39-8807-6ff268d99b4e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:06.767910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cab3f5-c07f-4c39-8807-6ff268d99b4e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:06.769324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 743/1471] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:06.775987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafdc2-5158-4758-a907-c0fb70c9e229 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:06.776537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafdc2-5158-4758-a907-c0fb70c9e229 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:06.776537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafdc2-5158-4758-a907-c0fb70c9e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:06.863790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ccaafdc2-5158-4758-a907-c0fb70c9e229 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:06.871245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ccaafdc2-5158-4758-a907-c0fb70c9e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:06.990589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 729/1472] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:20:07.314748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf6c5-66b1-4e70-accc-e1c80b6eb0e8 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:07.315175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf6c5-66b1-4e70-accc-e1c80b6eb0e8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:07.315552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddf6c5-66b1-4e70-accc-e1c80b6eb0e8 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:07.317335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 744/1473] 10.222.0.71 () {54 vars in 961 bytes} [Fri Sep 2 21:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:07.323877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb51c7a-ecee-4498-af65-cc07348c1629 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:07.324314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb51c7a-ecee-4498-af65-cc07348c1629 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:07.324687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb51c7a-ecee-4498-af65-cc07348c1629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:07.444178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ddb51c7a-ecee-4498-af65-cc07348c1629 None None] MFA Rules not processed for user `36f0ee202c7946db8c77e1048d092fde`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:07.454118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ddb51c7a-ecee-4498-af65-cc07348c1629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:07.469836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:07.548767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 730/1474] 10.222.0.71 () {58 vars in 1058 bytes} [Fri Sep 2 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:07.557149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddf6c5-66b1-4e70-accc-e1c80b6eb0e8 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:07.558678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f2ddf6c5-66b1-4e70-accc-e1c80b6eb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:07.703079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddf6c5-66b1-4e70-accc-e1c80b6eb0e8 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:07.799319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef5e7f-3dd1-43af-8b0c-0f96b1e7ea55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:07.800024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef5e7f-3dd1-43af-8b0c-0f96b1e7ea55 service glance] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:07.800154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef5e7f-3dd1-43af-8b0c-0f96b1e7ea55 service glance] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:07.800381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef5e7f-3dd1-43af-8b0c-0f96b1e7ea55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:07.802093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3fef5e7f-3dd1-43af-8b0c-0f96b1e7ea55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:07.881844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:07.950989 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef5e7f-3dd1-43af-8b0c-0f96b1e7ea55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:07.952521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef5e7f-3dd1-43af-8b0c-0f96b1e7ea55 service glance] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:07.974513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 745/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:10.101572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821a5f6-d22f-42ec-b553-53b2383bb444 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:10.102169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821a5f6-d22f-42ec-b553-53b2383bb444 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:10.102169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821a5f6-d22f-42ec-b553-53b2383bb444 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:10.103533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 731/1476] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:10.109499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db02f6-cd2a-4140-af4b-c4d897d1c3e8 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:10.110201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db02f6-cd2a-4140-af4b-c4d897d1c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:10.110201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db02f6-cd2a-4140-af4b-c4d897d1c3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:10.189787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-59db02f6-cd2a-4140-af4b-c4d897d1c3e8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:10.191119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-59db02f6-cd2a-4140-af4b-c4d897d1c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:10.521665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 746/1477] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:10.842312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821a5f6-d22f-42ec-b553-53b2383bb444 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:10.843860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a821a5f6-d22f-42ec-b553-53b2383bb444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:11.005369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821a5f6-d22f-42ec-b553-53b2383bb444 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:11.083040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:11.145495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e57e1-1495-4786-87be-b3d3e0d394ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:11.147568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e57e1-1495-4786-87be-b3d3e0d394ce admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:11.148160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e57e1-1495-4786-87be-b3d3e0d394ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:11.148540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e57e1-1495-4786-87be-b3d3e0d394ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:11.149579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e57e1-1495-4786-87be-b3d3e0d394ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:11.151639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-444e57e1-1495-4786-87be-b3d3e0d394ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:20:11.151639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:20:11.151639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:20:11.153144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e57e1-1495-4786-87be-b3d3e0d394ce admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:11.179652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 732/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Fri Sep 2 21:20:10 2022] GET /identity/v3/projects => generated 2553 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:20:13.277521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34d27-b224-4b9f-914a-c479a3ea1a74 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:13.278097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34d27-b224-4b9f-914a-c479a3ea1a74 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:13.278097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34d27-b224-4b9f-914a-c479a3ea1a74 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:13.279531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 747/1479] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:20:13.285821 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a81a-f028-4ab1-b478-df55493c0eb5 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:13.286379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a81a-f028-4ab1-b478-df55493c0eb5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:13.286845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a81a-f028-4ab1-b478-df55493c0eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:13.381524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f7d8a81a-f028-4ab1-b478-df55493c0eb5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:13.383038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f7d8a81a-f028-4ab1-b478-df55493c0eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:13.551127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 733/1480] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:13.894156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34d27-b224-4b9f-914a-c479a3ea1a74 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:13.895872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8ce34d27-b224-4b9f-914a-c479a3ea1a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:13.907228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:14.083984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34d27-b224-4b9f-914a-c479a3ea1a74 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:14.202479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:14.244162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aaaf2-c911-46c1-acce-2ace75ecb7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:14.244803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaaf2-c911-46c1-acce-2ace75ecb7a0 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:14.245087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaaf2-c911-46c1-acce-2ace75ecb7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:14.245348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaaf2-c911-46c1-acce-2ace75ecb7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:14.246995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-187aaaf2-c911-46c1-acce-2ace75ecb7a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:14.356359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaaf2-c911-46c1-acce-2ace75ecb7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:14.358018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaaf2-c911-46c1-acce-2ace75ecb7a0 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:14.377489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 748/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:20:16.611177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fbeaa-7fde-4d4c-b8f1-e8deee6137a6 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:16.611778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fbeaa-7fde-4d4c-b8f1-e8deee6137a6 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:16.611778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fbeaa-7fde-4d4c-b8f1-e8deee6137a6 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:16.613095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 734/1482] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:20:16.618742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20649-4586-4392-9989-57bbc8f92505 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:16.619296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20649-4586-4392-9989-57bbc8f92505 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:16.619296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20649-4586-4392-9989-57bbc8f92505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:16.691852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6fd20649-4586-4392-9989-57bbc8f92505 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:16.693118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6fd20649-4586-4392-9989-57bbc8f92505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:16.744064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:16.808644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 749/1483] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:17.118536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fbeaa-7fde-4d4c-b8f1-e8deee6137a6 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:17.121430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d67fbeaa-7fde-4d4c-b8f1-e8deee6137a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:17.157844 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:17.250563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fbeaa-7fde-4d4c-b8f1-e8deee6137a6 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:17.335274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10719e1d-75b2-4e98-b6ab-099caf6c0ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:17.335881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719e1d-75b2-4e98-b6ab-099caf6c0ada service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:17.336156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719e1d-75b2-4e98-b6ab-099caf6c0ada service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:17.336425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719e1d-75b2-4e98-b6ab-099caf6c0ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:17.338138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-10719e1d-75b2-4e98-b6ab-099caf6c0ada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:17.429273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:17.470722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10719e1d-75b2-4e98-b6ab-099caf6c0ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:17.472205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10719e1d-75b2-4e98-b6ab-099caf6c0ada service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:17.499922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 735/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:19.727619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e82f8-ecab-4227-8a1c-08d16a794d9b None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:19.728464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e82f8-ecab-4227-8a1c-08d16a794d9b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:19.728464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e82f8-ecab-4227-8a1c-08d16a794d9b None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:19.730692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 750/1485] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:20:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:19.739078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e96057-92ee-414d-9f73-e5476de05839 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:19.739740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e96057-92ee-414d-9f73-e5476de05839 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:19.739740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e96057-92ee-414d-9f73-e5476de05839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:19.856015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f2e96057-92ee-414d-9f73-e5476de05839 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:19.858137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f2e96057-92ee-414d-9f73-e5476de05839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:20.042170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 736/1486] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:20:20.361333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e82f8-ecab-4227-8a1c-08d16a794d9b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:20.362958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b06e82f8-ecab-4227-8a1c-08d16a794d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:20.522537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e82f8-ecab-4227-8a1c-08d16a794d9b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:20.634345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:20.636651 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83d6c4-8efc-4251-a8fa-98f593802cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:20.637742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d6c4-8efc-4251-a8fa-98f593802cec service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:20.638024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d6c4-8efc-4251-a8fa-98f593802cec service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:20.638306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d6c4-8efc-4251-a8fa-98f593802cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:20.640246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1e83d6c4-8efc-4251-a8fa-98f593802cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:20.842817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83d6c4-8efc-4251-a8fa-98f593802cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:20.845677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83d6c4-8efc-4251-a8fa-98f593802cec service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:20.868776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 751/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:23.145444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8146b6-410c-4d1b-bc3a-e6d6464b302b None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:23.146053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8146b6-410c-4d1b-bc3a-e6d6464b302b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:23.146053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8146b6-410c-4d1b-bc3a-e6d6464b302b None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:23.147869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 737/1488] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:23.154428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4849a-25db-4168-a3d6-02aff1cc0ee5 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:23.155878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4849a-25db-4168-a3d6-02aff1cc0ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:23.155878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4849a-25db-4168-a3d6-02aff1cc0ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:23.241344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b8e4849a-25db-4168-a3d6-02aff1cc0ee5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:23.242989 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b8e4849a-25db-4168-a3d6-02aff1cc0ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:23.308761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:23.363259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 752/1489] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:23.657416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8146b6-410c-4d1b-bc3a-e6d6464b302b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:23.659152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9a8146b6-410c-4d1b-bc3a-e6d6464b302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:23.699355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:23.790106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8146b6-410c-4d1b-bc3a-e6d6464b302b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:23.874241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e587-34c5-4aca-ae61-e58cca833a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:23.874848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e587-34c5-4aca-ae61-e58cca833a31 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:23.875176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e587-34c5-4aca-ae61-e58cca833a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:23.875453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e587-34c5-4aca-ae61-e58cca833a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:23.877102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-87b5e587-34c5-4aca-ae61-e58cca833a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:23.963991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:23.993109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e587-34c5-4aca-ae61-e58cca833a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:23.994584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e587-34c5-4aca-ae61-e58cca833a31 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:24.015343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 738/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:26.605161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2f47-436b-48c4-8ae0-c3c543692505 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:26.605748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2f47-436b-48c4-8ae0-c3c543692505 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:26.605748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2f47-436b-48c4-8ae0-c3c543692505 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:26.607433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 753/1491] 10.222.0.71 () {54 vars in 927 bytes} [Fri Sep 2 21:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:26.612895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0434ce-8649-4e16-a644-3c020c0afac3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:26.613352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0434ce-8649-4e16-a644-3c020c0afac3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:26.613470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0434ce-8649-4e16-a644-3c020c0afac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:26.691519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8f0434ce-8649-4e16-a644-3c020c0afac3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:26.692885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8f0434ce-8649-4e16-a644-3c020c0afac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:26.799964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 739/1492] 10.222.0.71 () {58 vars in 1024 bytes} [Fri Sep 2 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:27.101504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2f47-436b-48c4-8ae0-c3c543692505 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:27.103138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-29ef2f47-436b-48c4-8ae0-c3c543692505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:27.232349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2f47-436b-48c4-8ae0-c3c543692505 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:27.308551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf7c68-d6bc-47de-acb2-14c89033acc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:27.309381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf7c68-d6bc-47de-acb2-14c89033acc6 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:27.309890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf7c68-d6bc-47de-acb2-14c89033acc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:27.310231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf7c68-d6bc-47de-acb2-14c89033acc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:27.311866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-01cf7c68-d6bc-47de-acb2-14c89033acc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:27.321434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:27.447485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf7c68-d6bc-47de-acb2-14c89033acc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:27.449150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf7c68-d6bc-47de-acb2-14c89033acc6 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:27.469596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 754/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:36.798083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=82 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:37.467145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=50 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:21:55.598488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f679-1e6d-4f53-b172-f4a61793cf46 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:55.599097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f679-1e6d-4f53-b172-f4a61793cf46 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:55.599097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f679-1e6d-4f53-b172-f4a61793cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:55.687147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9fe1f679-1e6d-4f53-b172-f4a61793cf46 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:21:55.688939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9fe1f679-1e6d-4f53-b172-f4a61793cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:21:55.803011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 740/1494] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:21:55.811784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf167cc-5f25-4f65-9f66-bc9a278dd0d3 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:55.812303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf167cc-5f25-4f65-9f66-bc9a278dd0d3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:55.812412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf167cc-5f25-4f65-9f66-bc9a278dd0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:55.832230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2bf167cc-5f25-4f65-9f66-bc9a278dd0d3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:21:55.833454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2bf167cc-5f25-4f65-9f66-bc9a278dd0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:21:55.842479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 755/1495] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:21:55.847228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1f679-1e6d-4f53-b172-f4a61793cf46 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:55.857521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1f679-1e6d-4f53-b172-f4a61793cf46 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:55.862626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:55.863235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:55.863512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:55.863785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:55.864437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:21:55.864766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:55.865786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:55.865786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:21:55.865786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:21:55.866679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:55.879910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 741/1496] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:21:55.888824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf167cc-5f25-4f65-9f66-bc9a278dd0d3 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:55.898485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf167cc-5f25-4f65-9f66-bc9a278dd0d3 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:55.903387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:55.904009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:55.904288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:55.904558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:55.905254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:55.907093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING py.warnings [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:55.907093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: warnings.warn(msg) Sep 02 21:21:55.907093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: Sep 02 21:21:55.908305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:56.032605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 756/1497] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:21:55 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:21:56.036938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:56.048176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7b90d-f52e-475a-a562-c5d5ddac039a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:56.100564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:21:56.108108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:56.110320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.110320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.110320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.110320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:56.110951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:56.110951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:21:56.110951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:21:56.112174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:56.219785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 742/1498] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:21:56 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:21:56.224183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:56.235391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c052-f12d-4c2c-87f6-9021371b35ef admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:56.240709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:56.241336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.241616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.241888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.242528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:56.243555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING py.warnings [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:56.243555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: warnings.warn(msg) Sep 02 21:21:56.243555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: Sep 02 21:21:56.244434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:56.258231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 757/1499] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:21:56.262717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:56.276048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120221f-ef37-42e1-b5bb-aa4ea12c3913 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:56.280850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af738ecd-3c18-4ed8-9d84-dc21fd56cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:56.281462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738ecd-3c18-4ed8-9d84-dc21fd56cda1 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.281742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738ecd-3c18-4ed8-9d84-dc21fd56cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.282014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738ecd-3c18-4ed8-9d84-dc21fd56cda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.282999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af738ecd-3c18-4ed8-9d84-dc21fd56cda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:56.284099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-af738ecd-3c18-4ed8-9d84-dc21fd56cda1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:56.284099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:21:56.284099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:21:56.284927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af738ecd-3c18-4ed8-9d84-dc21fd56cda1 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:56.300270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 743/1500] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:21:56.304719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:56.315360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e83ec-5080-48db-a8ef-115aec6fc9f6 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:56.319997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782076b4-86dc-48e1-893d-2378815854e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:56.320656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782076b4-86dc-48e1-893d-2378815854e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.321526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782076b4-86dc-48e1-893d-2378815854e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.321526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782076b4-86dc-48e1-893d-2378815854e4 admin admin] PATH_INFO: `/v3/projects/b66088154d394397a384f498e947041b/users/a51b4dc4ef7b48559ef4de121c373fd8/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.339040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782076b4-86dc-48e1-893d-2378815854e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66088154d394397a384f498e947041b, user_id=a51b4dc4ef7b48559ef4de121c373fd8, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:56.340092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING py.warnings [None req-782076b4-86dc-48e1-893d-2378815854e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:56.340092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: warnings.warn(msg) Sep 02 21:21:56.340092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: Sep 02 21:21:56.342069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782076b4-86dc-48e1-893d-2378815854e4 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:56.458538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 758/1501] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:21:56 2022] PUT /identity/v3/projects/b66088154d394397a384f498e947041b/users/a51b4dc4ef7b48559ef4de121c373fd8/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:21:56.471657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe64c2-f204-4606-b6be-5e11f283b137 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.471938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe64c2-f204-4606-b6be-5e11f283b137 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.472214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe64c2-f204-4606-b6be-5e11f283b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.502526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-dcfe64c2-f204-4606-b6be-5e11f283b137 None None] MFA Rules not processed for user `a51b4dc4ef7b48559ef4de121c373fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:21:56.505430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dcfe64c2-f204-4606-b6be-5e11f283b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:21:56.578302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 744/1502] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:21:56.593261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaec8d-3bae-43c3-9c4b-7a02a5dc15a1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.593772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaec8d-3bae-43c3-9c4b-7a02a5dc15a1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.594273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaec8d-3bae-43c3-9c4b-7a02a5dc15a1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.595696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 759/1503] 10.222.0.71 () {54 vars in 964 bytes} [Fri Sep 2 21:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:21:56.602435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdb163-546b-40a8-b9a2-6d54de5dccc0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.603018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdb163-546b-40a8-b9a2-6d54de5dccc0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.603018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdb163-546b-40a8-b9a2-6d54de5dccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.669194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f1fdb163-546b-40a8-b9a2-6d54de5dccc0 None None] MFA Rules not processed for user `fb8b75d3cf3b46a79706c74501dc874e`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:21:56.670404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f1fdb163-546b-40a8-b9a2-6d54de5dccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:21:56.752022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 745/1504] 10.222.0.71 () {58 vars in 1061 bytes} [Fri Sep 2 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:21:56.760858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaec8d-3bae-43c3-9c4b-7a02a5dc15a1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:56.772760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaec8d-3bae-43c3-9c4b-7a02a5dc15a1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:56.777226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:56.777866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.778150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.778427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.787386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:56.788869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:56.797724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 760/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:21:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:21:56.845964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ae6c9-75d6-4f03-80dc-357a86e80c01 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.846249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ae6c9-75d6-4f03-80dc-357a86e80c01 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.846524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ae6c9-75d6-4f03-80dc-357a86e80c01 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.847839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 746/1506] 10.222.0.71 () {52 vars in 830 bytes} [Fri Sep 2 21:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:21:56.851650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:56.923741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242301b6-ce51-4b54-b829-4e20c92b353b service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:56.928568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:56.929240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:56.929546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:56.929871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] PATH_INFO: `/v3/users/a51b4dc4ef7b48559ef4de121c373fd8` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:56.931772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51b4dc4ef7b48559ef4de121c373fd8)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:56.932865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING py.warnings [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:56.932865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: warnings.warn(msg) Sep 02 21:21:56.932865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: Sep 02 21:21:56.934145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:57.269254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51b4dc4ef7b48559ef4de121c373fd8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:57.269939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51b4dc4ef7b48559ef4de121c373fd8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:57.373579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51b4dc4ef7b48559ef4de121c373fd8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:57.374309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51b4dc4ef7b48559ef4de121c373fd8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:57.392238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51b4dc4ef7b48559ef4de121c373fd8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:57.414246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:21:57.422278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 761/1507] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:21:56 2022] DELETE /identity/v3/users/a51b4dc4ef7b48559ef4de121c373fd8 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:21:57.435624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577204de-6914-45e9-b62a-863822336c42 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:57.435624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577204de-6914-45e9-b62a-863822336c42 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:57.435624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577204de-6914-45e9-b62a-863822336c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:57.448358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-577204de-6914-45e9-b62a-863822336c42 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:21:57.449609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-577204de-6914-45e9-b62a-863822336c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:21:57.465509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:21:57.517990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 747/1508] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:21:57.528275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:57.529702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:21:57.608058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef1160-98f0-49d3-848a-71a153b6cbc6 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:57.611779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab6803-a438-42f9-84da-fc313dbc90d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:57.613881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6803-a438-42f9-84da-fc313dbc90d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:57.613881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6803-a438-42f9-84da-fc313dbc90d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:57.613881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6803-a438-42f9-84da-fc313dbc90d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:57.623766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab6803-a438-42f9-84da-fc313dbc90d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:57.625257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab6803-a438-42f9-84da-fc313dbc90d8 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:57.635178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 762/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:21:58.170271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577204de-6914-45e9-b62a-863822336c42 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:21:58.171726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-577204de-6914-45e9-b62a-863822336c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:21:58.183426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577204de-6914-45e9-b62a-863822336c42 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:21:58.188059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:21:58.188691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:21:58.188995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:21:58.189264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] PATH_INFO: `/v3/projects/b66088154d394397a384f498e947041b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:21:58.190395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66088154d394397a384f498e947041b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:21:58.191415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:21:58.191415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:21:58.191415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:21:58.192606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:21:58.362134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66088154d394397a384f498e947041b', 'request_id': 'req-ee4b5d69-a301-4a7e-be13-fb585c9e15de'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:58.375630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66088154d394397a384f498e947041b', 'request_id': 'req-ee4b5d69-a301-4a7e-be13-fb585c9e15de'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:58.526491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66088154d394397a384f498e947041b', 'request_id': 'req-ee4b5d69-a301-4a7e-be13-fb585c9e15de'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:58.537916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] The token cache is being invalidate because project b66088154d394397a384f498e947041b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:21:58.538226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:58.538947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ee4b5d69-a301-4a7e-be13-fb585c9e15de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:21:58.540446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 748/1510] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:21:58 2022] DELETE /identity/v3/projects/b66088154d394397a384f498e947041b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:07.745563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:08.534803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:49.459309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f6e8-5960-4a47-91be-c54f35faeb3a None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:49.459874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f6e8-5960-4a47-91be-c54f35faeb3a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:49.459874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f6e8-5960-4a47-91be-c54f35faeb3a None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:49.461243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:23:49.466235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070276-00f2-4a4a-b170-9d7dd830e063 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:49.466678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070276-00f2-4a4a-b170-9d7dd830e063 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:49.466766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070276-00f2-4a4a-b170-9d7dd830e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:49.487834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e7070276-00f2-4a4a-b170-9d7dd830e063 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:49.489931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e7070276-00f2-4a4a-b170-9d7dd830e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:49.560435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:49.719576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89f6e8-5960-4a47-91be-c54f35faeb3a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:49.721537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6d89f6e8-5960-4a47-91be-c54f35faeb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:49.842268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89f6e8-5960-4a47-91be-c54f35faeb3a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:49.848451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6239e-c4a8-4d95-aad5-84be7f1a6d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:49.849085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6239e-c4a8-4d95-aad5-84be7f1a6d11 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:49.849369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6239e-c4a8-4d95-aad5-84be7f1a6d11 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:49.849695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6239e-c4a8-4d95-aad5-84be7f1a6d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:49.858869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6239e-c4a8-4d95-aad5-84be7f1a6d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:49.860526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6239e-c4a8-4d95-aad5-84be7f1a6d11 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:49.871014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 764/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:50.748841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dde566-bd95-4492-891f-7d95a96d5ab9 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:50.749422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dde566-bd95-4492-891f-7d95a96d5ab9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:50.749422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dde566-bd95-4492-891f-7d95a96d5ab9 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:50.750926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:23:50.756878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19007df-dc28-4b2d-b74a-3abb90831021 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:50.757438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19007df-dc28-4b2d-b74a-3abb90831021 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:50.757438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19007df-dc28-4b2d-b74a-3abb90831021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:50.777694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c19007df-dc28-4b2d-b74a-3abb90831021 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:50.778904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c19007df-dc28-4b2d-b74a-3abb90831021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:50.786975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:50.947924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dde566-bd95-4492-891f-7d95a96d5ab9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:50.963499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dde566-bd95-4492-891f-7d95a96d5ab9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:50.970038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07bb6-5511-4ce4-8bb5-fe81777f8308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:50.970802 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07bb6-5511-4ce4-8bb5-fe81777f8308 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:50.971099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07bb6-5511-4ce4-8bb5-fe81777f8308 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:50.971410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07bb6-5511-4ce4-8bb5-fe81777f8308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:50.983052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07bb6-5511-4ce4-8bb5-fe81777f8308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:50.984929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07bb6-5511-4ce4-8bb5-fe81777f8308 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:50.996059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 751/1516] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:54.711446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b362-6b9a-4478-9318-0b7e1e4067a3 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.712031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b362-6b9a-4478-9318-0b7e1e4067a3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.712031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b362-6b9a-4478-9318-0b7e1e4067a3 None None] PATH_INFO: `/v3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.713317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 766/1517] 10.222.0.102 () {54 vars in 926 bytes} [Fri Sep 2 21:23:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:54.725521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3660-79fe-42d5-9ade-5e8409db7079 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.725919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3660-79fe-42d5-9ade-5e8409db7079 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.726306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3660-79fe-42d5-9ade-5e8409db7079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.789224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c1fe3660-79fe-42d5-9ade-5e8409db7079 None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:54.790453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c1fe3660-79fe-42d5-9ade-5e8409db7079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.867589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 752/1518] 10.222.0.102 () {58 vars in 1016 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:00.772496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=49 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:02.301768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb168-a235-4e02-ba3e-e807641ae605 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:02.302748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb168-a235-4e02-ba3e-e807641ae605 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:02.302748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb168-a235-4e02-ba3e-e807641ae605 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:02.304025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 767/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:24:02.309082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4f97-1fe6-4283-b167-d79195deb70a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:02.309594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4f97-1fe6-4283-b167-d79195deb70a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:02.309737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff4f97-1fe6-4283-b167-d79195deb70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:02.329410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b8ff4f97-1fe6-4283-b167-d79195deb70a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:02.330616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b8ff4f97-1fe6-4283-b167-d79195deb70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:02.338810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 753/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:02.494100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eb168-a235-4e02-ba3e-e807641ae605 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:02.508891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eb168-a235-4e02-ba3e-e807641ae605 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:02.514705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fed4a-6fcc-45ef-b8a5-961c2e4a0a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:02.515300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fed4a-6fcc-45ef-b8a5-961c2e4a0a10 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:02.515583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fed4a-6fcc-45ef-b8a5-961c2e4a0a10 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:02.515857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fed4a-6fcc-45ef-b8a5-961c2e4a0a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:02.525627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fed4a-6fcc-45ef-b8a5-961c2e4a0a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:02.527299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fed4a-6fcc-45ef-b8a5-961c2e4a0a10 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:02.540474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 768/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:24:03.392253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3a93-33eb-421d-afe2-8465783b4881 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:03.393328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3a93-33eb-421d-afe2-8465783b4881 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:03.393328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3a93-33eb-421d-afe2-8465783b4881 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:03.394581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:24:03.401295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3001-7895-4fa6-87db-5c079ccd37ab None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:03.401823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3001-7895-4fa6-87db-5c079ccd37ab None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:03.402234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3001-7895-4fa6-87db-5c079ccd37ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:03.427307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-aa2d3001-7895-4fa6-87db-5c079ccd37ab None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:03.429015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-aa2d3001-7895-4fa6-87db-5c079ccd37ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:03.437382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:03.591001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3a93-33eb-421d-afe2-8465783b4881 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:03.606193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3a93-33eb-421d-afe2-8465783b4881 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:03.611884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42c5c0-944a-446e-b445-868333b00635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:03.612500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c5c0-944a-446e-b445-868333b00635 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:03.612860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c5c0-944a-446e-b445-868333b00635 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:03.613638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c5c0-944a-446e-b445-868333b00635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:03.622628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42c5c0-944a-446e-b445-868333b00635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:03.624205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42c5c0-944a-446e-b445-868333b00635 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:03.634431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 755/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:07.449004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd21-ca72-48ed-87f8-997f575cfaa6 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.449541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd21-ca72-48ed-87f8-997f575cfaa6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.449541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd21-ca72-48ed-87f8-997f575cfaa6 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.450822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 770/1525] 10.222.0.71 () {54 vars in 961 bytes} [Fri Sep 2 21:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:24:07.456036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25421be-3c6c-4ee7-9070-aecaea406543 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.456824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25421be-3c6c-4ee7-9070-aecaea406543 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.457438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25421be-3c6c-4ee7-9070-aecaea406543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.480680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a25421be-3c6c-4ee7-9070-aecaea406543 None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:07.481935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a25421be-3c6c-4ee7-9070-aecaea406543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:07.491606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 756/1526] 10.222.0.71 () {58 vars in 1058 bytes} [Fri Sep 2 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:07.499360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cd21-ca72-48ed-87f8-997f575cfaa6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:07.512868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cd21-ca72-48ed-87f8-997f575cfaa6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:07.518060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adba585-643c-428c-8d1d-669560ef453a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:07.518656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba585-643c-428c-8d1d-669560ef453a service placement] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.518963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba585-643c-428c-8d1d-669560ef453a service placement] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.519239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba585-643c-428c-8d1d-669560ef453a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.527628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adba585-643c-428c-8d1d-669560ef453a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:07.529268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adba585-643c-428c-8d1d-669560ef453a service placement] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:07.540679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 771/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:14.928197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484fd9-8e9d-4592-93ca-a071e5bc5e21 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:14.928853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484fd9-8e9d-4592-93ca-a071e5bc5e21 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:14.928853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484fd9-8e9d-4592-93ca-a071e5bc5e21 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:14.930145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:24:14.935577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e995aa-0444-49a7-881d-a2d3b15ba841 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:14.936344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e995aa-0444-49a7-881d-a2d3b15ba841 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:14.936344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e995aa-0444-49a7-881d-a2d3b15ba841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:14.959972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e8e995aa-0444-49a7-881d-a2d3b15ba841 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:14.961286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e8e995aa-0444-49a7-881d-a2d3b15ba841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:14.969718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:15.133484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a484fd9-8e9d-4592-93ca-a071e5bc5e21 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:15.156024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a484fd9-8e9d-4592-93ca-a071e5bc5e21 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:15.162505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6c650-a90a-40c5-8bf5-3d8195d3acf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:15.163118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c650-a90a-40c5-8bf5-3d8195d3acf1 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:15.163390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c650-a90a-40c5-8bf5-3d8195d3acf1 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:15.163662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6c650-a90a-40c5-8bf5-3d8195d3acf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:15.173189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6c650-a90a-40c5-8bf5-3d8195d3acf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:15.174854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6c650-a90a-40c5-8bf5-3d8195d3acf1 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:15.186071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 758/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:24:16.074645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350939c-09fd-46a0-9e52-683d1579594e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:16.075184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350939c-09fd-46a0-9e52-683d1579594e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:16.075184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350939c-09fd-46a0-9e52-683d1579594e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:16.076432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:24:16.085855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde8626-400b-4eac-9406-a819a1340544 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:16.086393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde8626-400b-4eac-9406-a819a1340544 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:16.086393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde8626-400b-4eac-9406-a819a1340544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:16.106387 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-dbde8626-400b-4eac-9406-a819a1340544 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:16.107655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dbde8626-400b-4eac-9406-a819a1340544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:16.116272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:16.275059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350939c-09fd-46a0-9e52-683d1579594e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:16.291188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350939c-09fd-46a0-9e52-683d1579594e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:16.296943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fdba7-7741-4de4-a509-7ea8e8cdedde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:16.297547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fdba7-7741-4de4-a509-7ea8e8cdedde service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:16.297819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fdba7-7741-4de4-a509-7ea8e8cdedde service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:16.298088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fdba7-7741-4de4-a509-7ea8e8cdedde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:16.308201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fdba7-7741-4de4-a509-7ea8e8cdedde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:16.309928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fdba7-7741-4de4-a509-7ea8e8cdedde service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:16.321404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 774/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:20.542746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59744-ed50-4c36-bc6c-87ccbf1052f5 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:20.543407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59744-ed50-4c36-bc6c-87ccbf1052f5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:20.543407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c59744-ed50-4c36-bc6c-87ccbf1052f5 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:20.544803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:24:20.550545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99620-6f8e-4ffe-af65-da1b64a0af46 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:20.551079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99620-6f8e-4ffe-af65-da1b64a0af46 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:20.551079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99620-6f8e-4ffe-af65-da1b64a0af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:20.571798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-77d99620-6f8e-4ffe-af65-da1b64a0af46 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:20.573057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-77d99620-6f8e-4ffe-af65-da1b64a0af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:20.581969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:20.880937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59744-ed50-4c36-bc6c-87ccbf1052f5 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:20.882732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c1c59744-ed50-4c36-bc6c-87ccbf1052f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:20.888678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:20.969961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c59744-ed50-4c36-bc6c-87ccbf1052f5 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:20.974973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db82a-d75b-4ac8-b1ac-1c6bd6309c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:20.975744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db82a-d75b-4ac8-b1ac-1c6bd6309c3b service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:20.976093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db82a-d75b-4ac8-b1ac-1c6bd6309c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:20.976434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db82a-d75b-4ac8-b1ac-1c6bd6309c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:20.993668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db82a-d75b-4ac8-b1ac-1c6bd6309c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:20.995448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db82a-d75b-4ac8-b1ac-1c6bd6309c3b service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:21.010226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 761/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:23.054764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29753-8c12-44d0-944e-ff3b52dc68a4 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:23.055299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29753-8c12-44d0-944e-ff3b52dc68a4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:23.055299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29753-8c12-44d0-944e-ff3b52dc68a4 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:23.056587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:24:23.062170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b4ba-5580-48d3-9991-0f643df65e29 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:23.062638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b4ba-5580-48d3-9991-0f643df65e29 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:23.062758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b4ba-5580-48d3-9991-0f643df65e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:23.083916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6f84b4ba-5580-48d3-9991-0f643df65e29 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:23.085194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6f84b4ba-5580-48d3-9991-0f643df65e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:23.093659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:23.391607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29753-8c12-44d0-944e-ff3b52dc68a4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:23.403596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29753-8c12-44d0-944e-ff3b52dc68a4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:23.407672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bd460-4d78-48a5-8558-62fc913b1a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:23.408266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bd460-4d78-48a5-8558-62fc913b1a87 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:23.408546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bd460-4d78-48a5-8558-62fc913b1a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:23.409351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bd460-4d78-48a5-8558-62fc913b1a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:23.419407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bd460-4d78-48a5-8558-62fc913b1a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:23.420965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bd460-4d78-48a5-8558-62fc913b1a87 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:23.433385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 777/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:27.055141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd60d-481c-4fe7-bc6e-fa4cad719974 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:27.055692 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd60d-481c-4fe7-bc6e-fa4cad719974 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:27.055692 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd60d-481c-4fe7-bc6e-fa4cad719974 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:27.056994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 763/1540] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:24:27.063088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffa3d7-d65f-4043-8874-e956404df6ab None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:27.064103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffa3d7-d65f-4043-8874-e956404df6ab None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:27.064103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffa3d7-d65f-4043-8874-e956404df6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:27.084543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-55ffa3d7-d65f-4043-8874-e956404df6ab None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:27.085810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-55ffa3d7-d65f-4043-8874-e956404df6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:27.094694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 778/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:27.689596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdd60d-481c-4fe7-bc6e-fa4cad719974 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:27.692976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-54bdd60d-481c-4fe7-bc6e-fa4cad719974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:27.759696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdd60d-481c-4fe7-bc6e-fa4cad719974 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:27.763442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4335-6fc1-44cb-bf67-d393d0ceafea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:27.764058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4335-6fc1-44cb-bf67-d393d0ceafea service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:27.764340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4335-6fc1-44cb-bf67-d393d0ceafea service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:27.764618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4335-6fc1-44cb-bf67-d393d0ceafea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:27.775866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4335-6fc1-44cb-bf67-d393d0ceafea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:27.777366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4335-6fc1-44cb-bf67-d393d0ceafea service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:27.787623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 764/1542] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:29.849185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019621d-c73b-4141-baff-d6ce019253ee None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:29.849757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019621d-c73b-4141-baff-d6ce019253ee None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:29.849757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019621d-c73b-4141-baff-d6ce019253ee None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:29.851239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 779/1543] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:24:29.857441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4622b-3526-4d65-ada9-65846300f23d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:29.858162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4622b-3526-4d65-ada9-65846300f23d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:29.858162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4622b-3526-4d65-ada9-65846300f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:29.881267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-71d4622b-3526-4d65-ada9-65846300f23d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:29.882555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-71d4622b-3526-4d65-ada9-65846300f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:29.895874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 765/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:30.476592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019621d-c73b-4141-baff-d6ce019253ee None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:30.478478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e019621d-c73b-4141-baff-d6ce019253ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:30.495632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019621d-c73b-4141-baff-d6ce019253ee None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:30.499939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdef94-2f9f-48b5-b17f-1b0817778f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:30.500558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdef94-2f9f-48b5-b17f-1b0817778f51 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:30.500873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdef94-2f9f-48b5-b17f-1b0817778f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:30.501266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdef94-2f9f-48b5-b17f-1b0817778f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:30.512852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdef94-2f9f-48b5-b17f-1b0817778f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:30.514390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdef94-2f9f-48b5-b17f-1b0817778f51 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:30.529344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 780/1545] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:39.874574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=57 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:40.522437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=42 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:07.925185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa1862-38d1-43e9-8bc1-53d93e25ecb3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:07.926324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa1862-38d1-43e9-8bc1-53d93e25ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:07.926840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa1862-38d1-43e9-8bc1-53d93e25ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:07.953376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-53aa1862-38d1-43e9-8bc1-53d93e25ecb3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:07.954655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-53aa1862-38d1-43e9-8bc1-53d93e25ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:07.956718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782541a-6bd5-4c78-ba01-409f0eaa20d7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:07.957630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782541a-6bd5-4c78-ba01-409f0eaa20d7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:07.958088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782541a-6bd5-4c78-ba01-409f0eaa20d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:07.966484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 766/1546] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:07.976185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625760-f750-4605-bc5d-0d3c85d75118 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:07.976472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625760-f750-4605-bc5d-0d3c85d75118 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:07.976720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625760-f750-4605-bc5d-0d3c85d75118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.002340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9782541a-6bd5-4c78-ba01-409f0eaa20d7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.004331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9782541a-6bd5-4c78-ba01-409f0eaa20d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.008597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-94625760-f750-4605-bc5d-0d3c85d75118 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.009994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-94625760-f750-4605-bc5d-0d3c85d75118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.019307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 781/1547] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:08.021621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 767/1548] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.026218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782541a-6bd5-4c78-ba01-409f0eaa20d7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.032797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11a7f-405d-485a-abad-34d7b1e28af9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.033106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11a7f-405d-485a-abad-34d7b1e28af9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.033465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11a7f-405d-485a-abad-34d7b1e28af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.041535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782541a-6bd5-4c78-ba01-409f0eaa20d7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.056039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.056980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.057470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.057915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.058758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:08.059236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.060441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING py.warnings [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:26:08.060441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: warnings.warn(msg) Sep 02 21:26:08.060441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: Sep 02 21:26:08.061904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.077129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-13e11a7f-405d-485a-abad-34d7b1e28af9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.078364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-13e11a7f-405d-485a-abad-34d7b1e28af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.086481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 782/1549] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:08.095751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.095997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 768/1550] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 02 21:26:08.102233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562917b-4e44-48ef-8865-0202f2e09b94 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.102418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562917b-4e44-48ef-8865-0202f2e09b94 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.102656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562917b-4e44-48ef-8865-0202f2e09b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.113925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4c7e2-4910-4f65-9e22-a4d98475bc24 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.125910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbc5e4-f099-41b4-bb19-3fed4abfdc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.126901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc5e4-f099-41b4-bb19-3fed4abfdc62 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.127381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc5e4-f099-41b4-bb19-3fed4abfdc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.127853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc5e4-f099-41b4-bb19-3fed4abfdc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.128688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbc5e4-f099-41b4-bb19-3fed4abfdc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.130941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbc5e4-f099-41b4-bb19-3fed4abfdc62 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.140759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8562917b-4e44-48ef-8865-0202f2e09b94 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.140759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8562917b-4e44-48ef-8865-0202f2e09b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.160753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 769/1551] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:08.160753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562917b-4e44-48ef-8865-0202f2e09b94 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.192549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562917b-4e44-48ef-8865-0202f2e09b94 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.192549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa1f2-3259-4ba3-9045-6fb4090acf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.192549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa1f2-3259-4ba3-9045-6fb4090acf09 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.192549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa1f2-3259-4ba3-9045-6fb4090acf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.193035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa1f2-3259-4ba3-9045-6fb4090acf09 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.193035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa1f2-3259-4ba3-9045-6fb4090acf09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:08.193035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa1f2-3259-4ba3-9045-6fb4090acf09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.193035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa1f2-3259-4ba3-9045-6fb4090acf09 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.203883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 770/1552] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:08.205251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5271efe-b602-472f-9ec6-dc21754571a4 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.205593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5271efe-b602-472f-9ec6-dc21754571a4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.205955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5271efe-b602-472f-9ec6-dc21754571a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.228004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c5271efe-b602-472f-9ec6-dc21754571a4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.229431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c5271efe-b602-472f-9ec6-dc21754571a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.238434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 771/1553] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.239675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec356-52d6-44ec-acbf-b987787c4547 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.239957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec356-52d6-44ec-acbf-b987787c4547 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.240228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec356-52d6-44ec-acbf-b987787c4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.261405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bb5ec356-52d6-44ec-acbf-b987787c4547 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.262649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bb5ec356-52d6-44ec-acbf-b987787c4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.271648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 772/1554] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.284444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0809-9ea5-4db5-a5bf-6fb879bc800d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.284444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0809-9ea5-4db5-a5bf-6fb879bc800d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.284444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0809-9ea5-4db5-a5bf-6fb879bc800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.297108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4cfd0809-9ea5-4db5-a5bf-6fb879bc800d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.298267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4cfd0809-9ea5-4db5-a5bf-6fb879bc800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.307542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 773/1555] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.308880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5926a-ec3b-4106-b351-b1824ebebece None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.309223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5926a-ec3b-4106-b351-b1824ebebece None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.309513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5926a-ec3b-4106-b351-b1824ebebece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.320885 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 783/1556] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:08.325296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218889-32f7-43ce-8341-1e16594d12c2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.325579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218889-32f7-43ce-8341-1e16594d12c2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.325851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218889-32f7-43ce-8341-1e16594d12c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.333780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-35b5926a-ec3b-4106-b351-b1824ebebece None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.335101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-35b5926a-ec3b-4106-b351-b1824ebebece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.348630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e0218889-32f7-43ce-8341-1e16594d12c2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.350056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e0218889-32f7-43ce-8341-1e16594d12c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.400536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 774/1557] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.401473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5926a-ec3b-4106-b351-b1824ebebece None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.411807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5926a-ec3b-4106-b351-b1824ebebece None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.416899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 784/1558] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.417094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928cc9-7523-4e0a-9819-82755e63ad9b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.417264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928cc9-7523-4e0a-9819-82755e63ad9b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.417577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928cc9-7523-4e0a-9819-82755e63ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.418302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.418921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.419258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.419732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.420918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.422041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:26:08.422041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:26:08.422041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:26:08.423433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.439916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-07928cc9-7523-4e0a-9819-82755e63ad9b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.441181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-07928cc9-7523-4e0a-9819-82755e63ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.450054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 785/1559] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.450598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07928cc9-7523-4e0a-9819-82755e63ad9b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.460694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07928cc9-7523-4e0a-9819-82755e63ad9b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.465734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e3a1b-4431-436b-8217-f2c1a8c32212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.466357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3a1b-4431-436b-8217-f2c1a8c32212 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.466640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3a1b-4431-436b-8217-f2c1a8c32212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.466917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3a1b-4431-436b-8217-f2c1a8c32212 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.468229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e3a1b-4431-436b-8217-f2c1a8c32212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:08.468902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e3a1b-4431-436b-8217-f2c1a8c32212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.470451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e3a1b-4431-436b-8217-f2c1a8c32212 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.483764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 786/1560] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:08.485183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995762b9-5d1d-4c21-83b6-826ecfa1b36c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.485496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995762b9-5d1d-4c21-83b6-826ecfa1b36c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.485773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995762b9-5d1d-4c21-83b6-826ecfa1b36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.506668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-995762b9-5d1d-4c21-83b6-826ecfa1b36c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.515102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-995762b9-5d1d-4c21-83b6-826ecfa1b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.517013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 787/1561] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.518405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82a41-193e-485a-a058-d11a5286ddd1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.518829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82a41-193e-485a-a058-d11a5286ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.519373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b82a41-193e-485a-a058-d11a5286ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.539487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-50b82a41-193e-485a-a058-d11a5286ddd1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.540721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-50b82a41-193e-485a-a058-d11a5286ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.548344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 775/1562] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:08.549333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.553130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 788/1563] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.554628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fe255-86f3-4aa7-89e3-6de1771d28c2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.554911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fe255-86f3-4aa7-89e3-6de1771d28c2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.555181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fe255-86f3-4aa7-89e3-6de1771d28c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.577393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-105fe255-86f3-4aa7-89e3-6de1771d28c2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.578806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-105fe255-86f3-4aa7-89e3-6de1771d28c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.623134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85e8a-aaaa-4530-946a-91e39140d9ca admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.630331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.630953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.631301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.631581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.632228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.634206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.646849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 789/1564] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.647882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600e841-e106-4497-bc45-40620be72734 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.648176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600e841-e106-4497-bc45-40620be72734 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.648453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600e841-e106-4497-bc45-40620be72734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.668614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e600e841-e106-4497-bc45-40620be72734 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.669854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e600e841-e106-4497-bc45-40620be72734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.678020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 790/1565] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.679193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410e9a-e1c4-4b65-b460-1166582b729c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.679476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410e9a-e1c4-4b65-b460-1166582b729c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.679749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410e9a-e1c4-4b65-b460-1166582b729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.699808 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7a410e9a-e1c4-4b65-b460-1166582b729c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.701149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7a410e9a-e1c4-4b65-b460-1166582b729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.709875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 791/1566] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.710657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410e9a-e1c4-4b65-b460-1166582b729c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.720460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410e9a-e1c4-4b65-b460-1166582b729c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.731316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.731316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.731316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.731316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.732330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.733679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.747063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:08.800846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 776/1567] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:08.800846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.813408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c925c-cbbb-48f3-8282-945e5fc13618 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.818298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.818916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.819198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.819506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.820171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:08.820476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.822192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.825226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:08.830995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 792/1568] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:08.831960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.841977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 777/1569] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:08.844290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.863672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3392a33-b7a5-49d9-a374-77c62e56dfd4 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.916287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56fda-7516-4211-91ac-adbd5815c144 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.922210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.923005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.923408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.923682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.924342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:08.924641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.926336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.947823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 793/1570] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:08.947823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.953865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624251f-4502-4ac1-a98d-af2d1df1fc6b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.958524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.959453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.959737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.960008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.960334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.960886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:08.961027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.961120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.961343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.961775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.962429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.962837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.964481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.979112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 794/1571] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:08.980050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.993413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430ec6a-11d9-4de6-b8b4-3e2be81effa7 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.002000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.002635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.002982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.003322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.003980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:09.004284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.006046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.022596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 795/1572] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:09.023631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.035076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82ab2-7893-417d-8ac4-8113378b6be5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.040350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.043521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.043521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.043521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.043521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:09.043521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.049918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.058620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 796/1573] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:09.059486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.070827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dabcf0-dc2d-4957-99a1-12c81f156400 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.076096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.076800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.077075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.077351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.078001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.079616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.080923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 778/1574] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.082618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.094361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb79c20-8682-4b2d-a3be-f6038657e32f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.098954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 797/1575] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:09.098954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.099853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.100482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.100783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.101256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.101918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.103938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.107771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c09f6-20e4-41d4-a09b-f4c0083752ad admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.113221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.113835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.114131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.114392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.115043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.117013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.234573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 779/1576] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.235402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.248068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d736dfa-0f56-478c-a469-2c0674d61e63 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.250485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 798/1577] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.251915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.334962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.335693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.336063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.336281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.337068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.339060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.364985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658e15-5491-4e93-93d4-8e2f344a7691 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.370127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.370758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.371029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.371369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.372008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.374071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.432264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 780/1578] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.433147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.453406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:09.460819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 799/1579] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.461644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.494274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:09.505457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef494c-1c97-4795-80f7-0a3221a6affc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.544890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf786cb-b411-4b49-8b79-482e9badc364 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.552254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.552654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.552971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.553334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.553904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.556549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.584512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.586554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.586554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.586554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.586554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.588610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.702552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 781/1580] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/projects => generated 365 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.702999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 800/1581] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.704619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.705189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.779217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986c9fe-3cee-4866-bca7-40752acce147 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.784524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.785175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.785461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.785730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.786380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.787996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.788773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904a65-e732-4829-a19a-662b1feb7f4a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.794691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.795230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.795554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.795832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.796489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.798161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.799547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 782/1582] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:09.800475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.811538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb7b4-aea4-485e-9f9e-947f10bbe4a3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.812912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 801/1583] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:09.816965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.817176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.818132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.818419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.818696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.819350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.821065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.827985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682095-5041-4d41-ba74-9e2e58d1a999 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.833178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 783/1584] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:09.833374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.833896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.834011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.834159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.834546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.835183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.836452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING py.warnings [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:26:09.836452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: warnings.warn(msg) Sep 02 21:26:09.836452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: Sep 02 21:26:09.837761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.847371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d29eb8-7c31-43a5-aad4-c43034742dc9 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.854224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.854848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.855123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.855396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.856593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.858367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.922895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 802/1585] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.923709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.933841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5903-5d9e-4b04-b1ba-885afc81cb9f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.938847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.939440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.939714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.939981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.940610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.942627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.963014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 784/1586] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:09.965171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.975404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc1964-7404-48ad-8bb1-b718f94cf9a3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.980369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.981000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.981281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.981554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.982186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.984097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.057198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 803/1587] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:10.057980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.068698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9003fa-0fca-44f7-9879-5f07bb2a3f5e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.074131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.074779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.075067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.075339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.076008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.079000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.134166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 785/1588] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:10.135013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.147116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bae2d-6a57-49c3-85b0-006e0cdde2b3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.152777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.153426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.153705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.154044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.154705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.156710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.167894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 786/1589] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.172431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.179622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee371a-3b9a-428f-9395-8be5e8e29325 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.184528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.185225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.185508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.185785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] PATH_INFO: `/v3/projects/db59729a0e314b5a8cdad6b0aec4bf0b/users/ba52c5881d6c42b5ac50272d4bc48ae7/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.203392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db59729a0e314b5a8cdad6b0aec4bf0b, user_id=ba52c5881d6c42b5ac50272d4bc48ae7, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.204466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:26:10.204466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:26:10.204466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:26:10.206482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.209062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 804/1590] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:10 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:10.209648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.220479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9343f6-35d5-44fe-b41c-cbaacf1d67d5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.226226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.226844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.227121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.227392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.228042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.230489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.241601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 805/1591] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.242203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.252870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70b564-4d12-4a1a-8867-166572a2f728 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.258395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.258822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.259445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.259445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.260085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.261819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.278919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 806/1592] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.278919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.283052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:10.287261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08eeac-e24b-4eca-b7a3-21dc50af9825 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.292740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.293362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.293642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.293914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.294553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.296171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.306869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 807/1593] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.308648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.318903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3562ef-fde0-4e1b-a0ec-35d201aa363e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.323781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.324382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.324670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.324976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.325616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.327818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.338745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 808/1594] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.339683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.343731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:10.348915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 787/1595] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:10 2022] PUT /identity/v3/projects/db59729a0e314b5a8cdad6b0aec4bf0b/users/ba52c5881d6c42b5ac50272d4bc48ae7/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:10.349669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.356170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dbe9a-94db-4d76-9133-dc1a28828462 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.421335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512f9d4-e6c5-4bce-8328-11349b218381 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.426729 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.427019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.427382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.427571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.427685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.427917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.428089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.428254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] PATH_INFO: `/v3/projects/69dfb3d27c444b62bafdb611d56c371e/users/0a36d1bb8e7144419296c6bce7bc61db/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.428543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.430241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.441703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 809/1596] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.442577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.446011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dfb3d27c444b62bafdb611d56c371e, user_id=0a36d1bb8e7144419296c6bce7bc61db, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.448707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.453001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7daa27-d560-4021-a36c-ad5d3b1376f8 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.458241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.462393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.462393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.462393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.462393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.462393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.473396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 810/1597] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.474373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.486479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad7ce6-8d56-4c1e-84c7-da8e0e9e836e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.492465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.496929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.496929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.496929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] PATH_INFO: `/v3/projects/87f8cfcf0fbe4659a1e424db6eb07a6a/users/5719fc040e0245768e698783961435f8/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.512087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f8cfcf0fbe4659a1e424db6eb07a6a, user_id=5719fc040e0245768e698783961435f8, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.514891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.524651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 788/1598] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:10 2022] PUT /identity/v3/projects/69dfb3d27c444b62bafdb611d56c371e/users/0a36d1bb8e7144419296c6bce7bc61db/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:10.531474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.595701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 811/1599] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:10 2022] PUT /identity/v3/projects/87f8cfcf0fbe4659a1e424db6eb07a6a/users/5719fc040e0245768e698783961435f8/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:10.596559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.600906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34e105-17e0-4bf1-be35-2ee54d0aed14 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.663532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.664162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.664605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.664925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.665584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.667190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.667298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa883f-8ce6-49b1-85af-32578b36126b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.673392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032e70d-8e1e-43ee-a7e3-16c81d720063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.674262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e70d-8e1e-43ee-a7e3-16c81d720063 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.674547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e70d-8e1e-43ee-a7e3-16c81d720063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.674819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e70d-8e1e-43ee-a7e3-16c81d720063 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.675481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e70d-8e1e-43ee-a7e3-16c81d720063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.677333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e70d-8e1e-43ee-a7e3-16c81d720063 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.679380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 789/1600] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.680223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.689407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 812/1601] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.691204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649472b9-3706-4089-b81e-a477e9f75605 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.691622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf96c-4ee5-4ab8-bfa3-5a31380b2303 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.692073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf96c-4ee5-4ab8-bfa3-5a31380b2303 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.692354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf96c-4ee5-4ab8-bfa3-5a31380b2303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.700306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.700986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.701279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.701675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.704477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.704477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.716120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 790/1602] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:10.718766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.720336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2b5cf96c-4ee5-4ab8-bfa3-5a31380b2303 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:10.721625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2b5cf96c-4ee5-4ab8-bfa3-5a31380b2303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:10.733773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 813/1603] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:10.733773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf96c-4ee5-4ab8-bfa3-5a31380b2303 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.734262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe47bab-01d2-46f3-a134-9e387d709c7c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.739812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5677d3-00bc-4acb-85d5-3451840b0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.740464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5677d3-00bc-4acb-85d5-3451840b0a0a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.740770 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5677d3-00bc-4acb-85d5-3451840b0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.741163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5677d3-00bc-4acb-85d5-3451840b0a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.100938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5677d3-00bc-4acb-85d5-3451840b0a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.100938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5677d3-00bc-4acb-85d5-3451840b0a0a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.102692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cf96c-4ee5-4ab8-bfa3-5a31380b2303 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.102692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3653ae2-0161-431b-846d-fed7220de7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.102692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653ae2-0161-431b-846d-fed7220de7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.102692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653ae2-0161-431b-846d-fed7220de7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.103796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653ae2-0161-431b-846d-fed7220de7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.103796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3653ae2-0161-431b-846d-fed7220de7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.103796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3653ae2-0161-431b-846d-fed7220de7c9 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.104135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 791/1604] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:11.104135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761126-691d-4fa2-9252-f868ea2d2f9b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.104135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761126-691d-4fa2-9252-f868ea2d2f9b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.104135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761126-691d-4fa2-9252-f868ea2d2f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.104578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 814/1605] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:11.104578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee19d82-f1d6-45df-ba9e-f4fe4f544a0f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.104578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee19d82-f1d6-45df-ba9e-f4fe4f544a0f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.104578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee19d82-f1d6-45df-ba9e-f4fe4f544a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.105316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:11.105316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-94761126-691d-4fa2-9252-f868ea2d2f9b None None] MFA Rules not processed for user `0a36d1bb8e7144419296c6bce7bc61db`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.105674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-dee19d82-f1d6-45df-ba9e-f4fe4f544a0f None None] MFA Rules not processed for user `5719fc040e0245768e698783961435f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.105760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-94761126-691d-4fa2-9252-f868ea2d2f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.105892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-dee19d82-f1d6-45df-ba9e-f4fe4f544a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.105892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:11.105892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 815/1606] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.105892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee19d82-f1d6-45df-ba9e-f4fe4f544a0f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.106233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 792/1607] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.106233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761126-691d-4fa2-9252-f868ea2d2f9b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.106399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee19d82-f1d6-45df-ba9e-f4fe4f544a0f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.106399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.106399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.106399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.106652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] PATH_INFO: `/v3/projects/398a5c8f96574b19bcb400865d6e1536/users/fa44c485963e4c3f9f26e36ba7d99d9c/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.106718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761126-691d-4fa2-9252-f868ea2d2f9b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.106718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.106718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.106718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.107083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] PATH_INFO: `/v3/projects/fd2d953f062345ea90c4f07323bf89be/users/e4ee406036b54e8f862cbcc942fc985b/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.107180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398a5c8f96574b19bcb400865d6e1536, user_id=fa44c485963e4c3f9f26e36ba7d99d9c, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.107180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.107393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d953f062345ea90c4f07323bf89be, user_id=e4ee406036b54e8f862cbcc942fc985b, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.107393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.112473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 816/1608] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:10 2022] PUT /identity/v3/projects/398a5c8f96574b19bcb400865d6e1536/users/fa44c485963e4c3f9f26e36ba7d99d9c/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:11.113679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.193584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806908-0bfa-46f3-af28-d4a513a68398 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.194226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 793/1609] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:10 2022] PUT /identity/v3/projects/fd2d953f062345ea90c4f07323bf89be/users/e4ee406036b54e8f862cbcc942fc985b/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:11.195068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.267057 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc687cc6-0bdc-4b17-a2f9-738bc1e3f5ad admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.268225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.269208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.269495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.269850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] PATH_INFO: `/v3/projects/0b6f0f2a7ea249e4bc8ae87f25b088a0/users/e43f913fbce54697b3261efc93ad9e12/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.271485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.272127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.272410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.272749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.284265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.285755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.287929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6f0f2a7ea249e4bc8ae87f25b088a0, user_id=e43f913fbce54697b3261efc93ad9e12, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.291055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.297557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 794/1610] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:11.298395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.309214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83862-4d16-428b-a0d5-6ed65cf95f59 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.314132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.314794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.315079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.315345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] PATH_INFO: `/v3/projects/55a1a6fc049741acb6d1d407a3162330/users/a159834384664a27963c1209ebdf0c6f/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.333733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a1a6fc049741acb6d1d407a3162330, user_id=a159834384664a27963c1209ebdf0c6f, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.336603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.371461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 817/1611] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:11 2022] PUT /identity/v3/projects/0b6f0f2a7ea249e4bc8ae87f25b088a0/users/e43f913fbce54697b3261efc93ad9e12/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:11.372398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.394557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:11.440643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d4e3-e951-4ddf-93fa-53b3e6a28912 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.445445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a95a2-b83e-497a-88c1-bb3a78653be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.446120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a95a2-b83e-497a-88c1-bb3a78653be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.446397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a95a2-b83e-497a-88c1-bb3a78653be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.446672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a95a2-b83e-497a-88c1-bb3a78653be7 admin admin] PATH_INFO: `/v3/projects/cb747266dddb45e695b0c667ee28fa18/users/1f12fa71a876411f91c2bbaf3c9080ce/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.470814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 795/1612] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:11 2022] PUT /identity/v3/projects/55a1a6fc049741acb6d1d407a3162330/users/a159834384664a27963c1209ebdf0c6f/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:11.470814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.471170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a95a2-b83e-497a-88c1-bb3a78653be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb747266dddb45e695b0c667ee28fa18, user_id=1f12fa71a876411f91c2bbaf3c9080ce, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.473738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a95a2-b83e-497a-88c1-bb3a78653be7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.528928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:11.544702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70de3-0ab0-4c8a-b296-c4bf959f4c7e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.550239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c19421-9235-43db-9419-3bdf6cc4215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.551378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19421-9235-43db-9419-3bdf6cc4215b admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.551378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19421-9235-43db-9419-3bdf6cc4215b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.551679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19421-9235-43db-9419-3bdf6cc4215b admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.552202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c19421-9235-43db-9419-3bdf6cc4215b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.554157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c19421-9235-43db-9419-3bdf6cc4215b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.599738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 818/1613] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:11 2022] PUT /identity/v3/projects/cb747266dddb45e695b0c667ee28fa18/users/1f12fa71a876411f91c2bbaf3c9080ce/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:11.601104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f5903-7464-4a0e-8664-03fa3713a85c None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.601665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f5903-7464-4a0e-8664-03fa3713a85c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.601665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f5903-7464-4a0e-8664-03fa3713a85c None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.603141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 819/1614] 10.222.0.71 () {54 vars in 962 bytes} [Fri Sep 2 21:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:11.604584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92625-8314-4407-9200-e69d928401b7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.604899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92625-8314-4407-9200-e69d928401b7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.605246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a92625-8314-4407-9200-e69d928401b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.626752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-52a92625-8314-4407-9200-e69d928401b7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.627905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-52a92625-8314-4407-9200-e69d928401b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.692179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 820/1615] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.693495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601d35-2890-4622-b58a-c3470de7fcc3 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.693783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601d35-2890-4622-b58a-c3470de7fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.694062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601d35-2890-4622-b58a-c3470de7fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.717458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7d601d35-2890-4622-b58a-c3470de7fcc3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.719251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7d601d35-2890-4622-b58a-c3470de7fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.723508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 796/1616] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:11 2022] POST /identity/v3/projects => generated 365 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:11.725127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5496e-d4d2-4bf2-963f-9844052079e3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.725619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5496e-d4d2-4bf2-963f-9844052079e3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.726114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5496e-d4d2-4bf2-963f-9844052079e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.736974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 821/1617] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.741036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971504cc-9e41-4aa8-9080-34068f36d9b0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.741475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971504cc-9e41-4aa8-9080-34068f36d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.741762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971504cc-9e41-4aa8-9080-34068f36d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.763473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-14e5496e-d4d2-4bf2-963f-9844052079e3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.765754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-14e5496e-d4d2-4bf2-963f-9844052079e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.784226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-971504cc-9e41-4aa8-9080-34068f36d9b0 None None] MFA Rules not processed for user `a159834384664a27963c1209ebdf0c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.785586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-971504cc-9e41-4aa8-9080-34068f36d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.868833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 822/1618] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.876463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b756f-ed34-4568-94a9-1310ba0ac555 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.877283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b756f-ed34-4568-94a9-1310ba0ac555 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.877583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b756f-ed34-4568-94a9-1310ba0ac555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.883956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 797/1619] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.885519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5d9a2-d3a0-44ac-922a-0c10bc1bb4ed None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.885859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5d9a2-d3a0-44ac-922a-0c10bc1bb4ed None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.886351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5d9a2-d3a0-44ac-922a-0c10bc1bb4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.906478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-426b756f-ed34-4568-94a9-1310ba0ac555 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.907703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-426b756f-ed34-4568-94a9-1310ba0ac555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.916057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 823/1620] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.916974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b756f-ed34-4568-94a9-1310ba0ac555 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.939334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-dcc5d9a2-d3a0-44ac-922a-0c10bc1bb4ed None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:11.940625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dcc5d9a2-d3a0-44ac-922a-0c10bc1bb4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.951068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:12.007603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b756f-ed34-4568-94a9-1310ba0ac555 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.012328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.013438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.013965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.014879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.027067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.029944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.031022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 798/1621] 10.222.0.71 () {58 vars in 1059 bytes} [Fri Sep 2 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:12.031994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5d9a2-d3a0-44ac-922a-0c10bc1bb4ed None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.043444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5d9a2-d3a0-44ac-922a-0c10bc1bb4ed None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.049719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.050381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.050680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.050929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.051583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.053598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.057544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 824/1622] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:12.058531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.060868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:12.077798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c25792-6e12-4321-8fdf-d8972382dbc3 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.082124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.082873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.083171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.083441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.094255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.095777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.107509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 825/1623] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:12.109925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.184146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9b30-8034-4eea-ad52-6edee483d500 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.189143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.189762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.190044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.190322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.199823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.202113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.214602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 826/1624] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:12.219625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.220288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 799/1625] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:12 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:12.221654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.234222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71644637-eb11-4d72-968b-cfd1e07baae5 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.235212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a186b-a1e4-4891-baaf-e3f0fabab9af admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.239769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.240430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.240949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.241216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.242436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.243065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.243339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.243605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.259157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.259704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.262105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.262371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.273487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 800/1626] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:12.275754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 827/1627] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:12.276755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.278051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.288829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4607ee3-9e44-4cf7-babe-363c34660177 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.294258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.294954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.297009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.297009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.297541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.299296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.300381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d124f-1f7f-48a3-a05d-ba676915b86d service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.316571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 828/1628] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:12.318694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.321332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.322395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.322940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.323514 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.332366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c005ab7-e7a9-4bfd-ab63-db1f12410ed5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.338389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.339343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.339732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.340215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] PATH_INFO: `/v3/projects/a913231f7477414f963d8255fa52417c/users/b48661de13b34290aca56dcbd9906ff9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.374664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:12.380582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a913231f7477414f963d8255fa52417c, user_id=b48661de13b34290aca56dcbd9906ff9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.388106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.469050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.472428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.493241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 801/1629] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:12.547983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 829/1630] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:12 2022] PUT /identity/v3/projects/a913231f7477414f963d8255fa52417c/users/b48661de13b34290aca56dcbd9906ff9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:26:12.554119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.581980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9158713-9c20-4a1d-aee4-41995f8e7bfb service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.740647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefee14-e829-41ef-bdf8-75cf0bf04547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.741840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefee14-e829-41ef-bdf8-75cf0bf04547 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.743533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefee14-e829-41ef-bdf8-75cf0bf04547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.743994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefee14-e829-41ef-bdf8-75cf0bf04547 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.744879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefee14-e829-41ef-bdf8-75cf0bf04547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.747347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefee14-e829-41ef-bdf8-75cf0bf04547 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.762039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 802/1631] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:12.768781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.787631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61236-52d8-43ae-a328-326e2d88dc93 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.807624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.808655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.809086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.809467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] PATH_INFO: `/v3/projects/a913231f7477414f963d8255fa52417c/users/b48661de13b34290aca56dcbd9906ff9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.814333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a913231f7477414f963d8255fa52417c, user_id=b48661de13b34290aca56dcbd9906ff9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.822329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:12.859162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 830/1632] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:12 2022] PUT /identity/v3/projects/a913231f7477414f963d8255fa52417c/users/b48661de13b34290aca56dcbd9906ff9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:12.870351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f9a9-7aab-4124-9282-002cf9f3ae5c None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.870698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f9a9-7aab-4124-9282-002cf9f3ae5c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.871136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f9a9-7aab-4124-9282-002cf9f3ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.937212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c996f9a9-7aab-4124-9282-002cf9f3ae5c None None] MFA Rules not processed for user `b48661de13b34290aca56dcbd9906ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:12.938903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c996f9a9-7aab-4124-9282-002cf9f3ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:13.055092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 803/1633] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:13.067279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:13.148831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:13.152763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58e36-9f35-42cb-b38f-c15651777497 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:13.163377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33844d75-776d-40b7-b58a-e54ec6a64d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:13.164258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844d75-776d-40b7-b58a-e54ec6a64d21 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.164753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844d75-776d-40b7-b58a-e54ec6a64d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.165214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33844d75-776d-40b7-b58a-e54ec6a64d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.177717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33844d75-776d-40b7-b58a-e54ec6a64d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:13.180027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33844d75-776d-40b7-b58a-e54ec6a64d21 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:13.192516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 831/1634] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:13.203843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdbd8f-7bd4-4a43-8758-f09ea6baed47 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.204294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdbd8f-7bd4-4a43-8758-f09ea6baed47 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.205121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdbd8f-7bd4-4a43-8758-f09ea6baed47 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.207149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 804/1635] 10.222.0.71 () {54 vars in 962 bytes} [Fri Sep 2 21:26:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:13.223592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75959-fe94-491e-8891-ceebdf6fadd8 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.227429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75959-fe94-491e-8891-ceebdf6fadd8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.227715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75959-fe94-491e-8891-ceebdf6fadd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.269815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-8ee75959-fe94-491e-8891-ceebdf6fadd8 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:13.270697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8ee75959-fe94-491e-8891-ceebdf6fadd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:13.391506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 832/1636] 10.222.0.71 () {58 vars in 1059 bytes} [Fri Sep 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:13.397898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87f3fc-37f8-486a-8bea-0d97b7ef393d None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.398469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87f3fc-37f8-486a-8bea-0d97b7ef393d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.398469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87f3fc-37f8-486a-8bea-0d97b7ef393d None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.399819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 805/1637] 10.222.0.71 () {54 vars in 912 bytes} [Fri Sep 2 21:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:13.410205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29a1c-6033-45e7-acaf-b5e23591eee7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.410205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29a1c-6033-45e7-acaf-b5e23591eee7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.410205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29a1c-6033-45e7-acaf-b5e23591eee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.434887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2ec29a1c-6033-45e7-acaf-b5e23591eee7 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:13.437356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2ec29a1c-6033-45e7-acaf-b5e23591eee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:13.459379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 833/1638] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:13.616653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87f3fc-37f8-486a-8bea-0d97b7ef393d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:13.629328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87f3fc-37f8-486a-8bea-0d97b7ef393d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:13.634093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3d6f0-2107-4a4b-b45c-6ae3b8a8785b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:13.634945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d6f0-2107-4a4b-b45c-6ae3b8a8785b service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.635616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d6f0-2107-4a4b-b45c-6ae3b8a8785b service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.635616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d6f0-2107-4a4b-b45c-6ae3b8a8785b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.649814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3d6f0-2107-4a4b-b45c-6ae3b8a8785b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:13.650961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3d6f0-2107-4a4b-b45c-6ae3b8a8785b service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:13.663897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 806/1639] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:13.736032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29a1c-6033-45e7-acaf-b5e23591eee7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:13.751123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29a1c-6033-45e7-acaf-b5e23591eee7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:13.759499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:13.759499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.759499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.759499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.818158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86bb3-f5e4-4b7c-90fd-12e4325b2ed7 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.823399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86bb3-f5e4-4b7c-90fd-12e4325b2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.823399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86bb3-f5e4-4b7c-90fd-12e4325b2ed7 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.823399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 807/1640] 10.222.0.71 () {54 vars in 912 bytes} [Fri Sep 2 21:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:13.827253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d7cc-6559-47e3-a5b8-3482cf05a851 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.827536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d7cc-6559-47e3-a5b8-3482cf05a851 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.827816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d7cc-6559-47e3-a5b8-3482cf05a851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.863707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-dee1d7cc-6559-47e3-a5b8-3482cf05a851 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:13.865098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dee1d7cc-6559-47e3-a5b8-3482cf05a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:13.867026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:13.868931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:13.877477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 808/1641] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:13.886888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 834/1642] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:14.107018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d7cc-6559-47e3-a5b8-3482cf05a851 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:14.123176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d7cc-6559-47e3-a5b8-3482cf05a851 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:14.127902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316edc9-aaf3-4260-a4b8-3b3a73d11601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:14.129319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316edc9-aaf3-4260-a4b8-3b3a73d11601 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:14.129319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316edc9-aaf3-4260-a4b8-3b3a73d11601 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:14.129745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316edc9-aaf3-4260-a4b8-3b3a73d11601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:14.146076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316edc9-aaf3-4260-a4b8-3b3a73d11601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:14.148251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316edc9-aaf3-4260-a4b8-3b3a73d11601 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:14.179981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 809/1643] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:14.329938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:14.426377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90d3c-f0ec-4b79-a019-3346fb39ea40 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:14.431397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:14.432132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:14.434845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:14.435389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] PATH_INFO: `/v3/users/0a36d1bb8e7144419296c6bce7bc61db` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:14.437799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a36d1bb8e7144419296c6bce7bc61db)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:14.441466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:14.793513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:14.798269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a36d1bb8e7144419296c6bce7bc61db'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:14.805549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a36d1bb8e7144419296c6bce7bc61db'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:14.954358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a36d1bb8e7144419296c6bce7bc61db'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:14.955106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a36d1bb8e7144419296c6bce7bc61db'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:14.967313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a36d1bb8e7144419296c6bce7bc61db'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:15.009543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 835/1644] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:14 2022] DELETE /identity/v3/users/0a36d1bb8e7144419296c6bce7bc61db => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:15.012827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:15.013311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:15.013549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:15.045789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:15.047078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:15.051748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:15.142756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 810/1645] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:15.154128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:15.168995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:15.310398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113ba3-47ae-41e7-b721-98ba06db07c5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:15.330913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c5783-82cf-4643-841c-b2ecb160bf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:15.336234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5783-82cf-4643-841c-b2ecb160bf0b service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:15.344022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5783-82cf-4643-841c-b2ecb160bf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:15.344022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5783-82cf-4643-841c-b2ecb160bf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:15.391508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5783-82cf-4643-841c-b2ecb160bf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:15.398305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5783-82cf-4643-841c-b2ecb160bf0b service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:15.455004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 836/1646] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:17.117014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:17.118725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:17.162866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c540-4cbd-4425-8a14-f43cf630cf25 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:17.188037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:17.188715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:17.192454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:17.196095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] PATH_INFO: `/v3/projects/69dfb3d27c444b62bafdb611d56c371e` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:17.202536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69dfb3d27c444b62bafdb611d56c371e)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:17.205101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:17.500768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69dfb3d27c444b62bafdb611d56c371e', 'request_id': 'req-11413e70-edfc-49e4-ab8c-e78a5f20f837'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:17.510328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69dfb3d27c444b62bafdb611d56c371e', 'request_id': 'req-11413e70-edfc-49e4-ab8c-e78a5f20f837'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:17.642439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69dfb3d27c444b62bafdb611d56c371e', 'request_id': 'req-11413e70-edfc-49e4-ab8c-e78a5f20f837'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:17.671799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] The token cache is being invalidate because project 69dfb3d27c444b62bafdb611d56c371e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:17.671799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:17.674053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-11413e70-edfc-49e4-ab8c-e78a5f20f837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:17.677573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 811/1647] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:17 2022] DELETE /identity/v3/projects/69dfb3d27c444b62bafdb611d56c371e => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:17.685075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e1ba-29b5-431e-9532-3b6536733448 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:17.686147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e1ba-29b5-431e-9532-3b6536733448 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:17.686796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e1ba-29b5-431e-9532-3b6536733448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:17.725730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b910e1ba-29b5-431e-9532-3b6536733448 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:17.760206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b910e1ba-29b5-431e-9532-3b6536733448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:17.877582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 837/1648] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:17.886184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d17d-8040-4f73-a66e-c1022ee13ba9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:17.886817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d17d-8040-4f73-a66e-c1022ee13ba9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:17.887921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d17d-8040-4f73-a66e-c1022ee13ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:17.923588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-be61d17d-8040-4f73-a66e-c1022ee13ba9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:17.928775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-be61d17d-8040-4f73-a66e-c1022ee13ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:17.947214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 812/1649] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:17.949460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e1ba-29b5-431e-9532-3b6536733448 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:17.973971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e1ba-29b5-431e-9532-3b6536733448 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:18.000392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:18.003593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.009378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.010281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.011618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:18.012981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:18.017582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:18.059456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 838/1650] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:18.065065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61d17d-8040-4f73-a66e-c1022ee13ba9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:18.080348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61d17d-8040-4f73-a66e-c1022ee13ba9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:18.091545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:18.092572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.093268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.093797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.094567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:18.098063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:18.354458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 813/1651] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:18 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:18.358934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:18.369787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e01ab-cce5-4eff-8eab-37843b7e01cf admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:18.400057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:18.469666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:18.472889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.472889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.472889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.472889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:18.477533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:18.605705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 839/1652] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:18 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:18.610563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:18.630485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc9f45-5edf-4293-8dcb-a48c6bbbcc0e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:18.642389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:18.644661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.645521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.646781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.648032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:18.650995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:18.675126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 814/1653] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:18.678644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:18.698202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19b59-3047-4ade-81c4-bf642dcb2deb admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:18.709570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7258c-5097-4668-aebf-782685597b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:18.710434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7258c-5097-4668-aebf-782685597b9b admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.711009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7258c-5097-4668-aebf-782685597b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.711438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7258c-5097-4668-aebf-782685597b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.712236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7258c-5097-4668-aebf-782685597b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:18.714492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7258c-5097-4668-aebf-782685597b9b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:18.738381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 840/1654] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:18.741923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:18.757047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3448ce-5ca2-4ced-b06c-01a0f24bc7d4 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:18.767103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:18.776042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.776477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.780599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] PATH_INFO: `/v3/projects/759ce814453e47b296cfb52b110d90fe/users/5b62326fee7542cfaf0fabd3e744dc98/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.814519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759ce814453e47b296cfb52b110d90fe, user_id=5b62326fee7542cfaf0fabd3e744dc98, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:18.817951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:18.965563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 815/1655] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:18 2022] PUT /identity/v3/projects/759ce814453e47b296cfb52b110d90fe/users/5b62326fee7542cfaf0fabd3e744dc98/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:18.978224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91630aaf-ca8e-4b3a-9101-ad84032586f6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.978550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91630aaf-ca8e-4b3a-9101-ad84032586f6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.978928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91630aaf-ca8e-4b3a-9101-ad84032586f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:19.048218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-91630aaf-ca8e-4b3a-9101-ad84032586f6 None None] MFA Rules not processed for user `5b62326fee7542cfaf0fabd3e744dc98`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:19.050159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-91630aaf-ca8e-4b3a-9101-ad84032586f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:19.187457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 841/1656] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:19.188860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:19.307664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:19.392385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4491-f4e3-43ff-aeb0-5faa4fb6aa57 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:19.406298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:19.411346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:19.411346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:19.411346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:19.411346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:19.412341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:19.673287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 816/1657] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:19 2022] POST /identity/v3/projects => generated 387 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:19.677650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91630aaf-ca8e-4b3a-9101-ad84032586f6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:19.703048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91630aaf-ca8e-4b3a-9101-ad84032586f6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:19.978515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:19.981935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:19.982295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:19.983903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:19.986579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:19.997671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:20.000715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:20.004767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:20.028650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af6ce3-5efa-4682-a87c-72357c88f3cf admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:20.036181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:20.037409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:20.037895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:20.038426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] PATH_INFO: `/v3/users/5719fc040e0245768e698783961435f8` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:20.040263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5719fc040e0245768e698783961435f8)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:20.041765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: WARNING py.warnings [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:26:20.041765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: warnings.warn(msg) Sep 02 21:26:20.041765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: Sep 02 21:26:20.043643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:20.112968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 842/1658] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:19 2022] POST /identity/v3/users => generated 300 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:20.117638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:20.154922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1bc6-8d79-4b84-aabc-f9911d7014c7 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:20.169220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:20.169220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:20.169405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:20.170626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:20.170982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:20.172622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:20.200873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 843/1659] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:20.205585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:20.227567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e8a6e-ae9d-4a59-96d1-d5fffd7f82dd admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:20.244688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:20.245408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:20.245688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:20.246311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] PATH_INFO: `/v3/projects/08625b26363a4896925b82029d5b09c5/users/f3e586802f6d489697b051999f6113b8/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:20.286189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08625b26363a4896925b82029d5b09c5, user_id=f3e586802f6d489697b051999f6113b8, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:20.290667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:20.388167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5719fc040e0245768e698783961435f8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:20.463750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 844/1660] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:20 2022] PUT /identity/v3/projects/08625b26363a4896925b82029d5b09c5/users/f3e586802f6d489697b051999f6113b8/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:26:20.469766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:20.480705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:20.564083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5719fc040e0245768e698783961435f8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:20.565461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5719fc040e0245768e698783961435f8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:20.639518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5719fc040e0245768e698783961435f8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:20.679454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272550-7123-4340-ba44-a0568e4f906a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:20.681159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-26d0f948-c25d-4f1b-a08b-917b7cc849b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5719fc040e0245768e698783961435f8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:20.691048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:20.697307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:20.698942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 817/1661] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:19 2022] DELETE /identity/v3/users/5719fc040e0245768e698783961435f8 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:20.699888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:20.700229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:20.701247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:20.702045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:20.702149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:20.702592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:20.706993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:20.733546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:20.735084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:20.746226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 845/1662] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:20.747452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:20.754165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:20.795724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c876fb-7440-42f4-9419-e638ce08038a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:20.864020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 818/1663] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:20.927713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:20.929491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:20.979623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eb43d-c864-46fc-a3bd-562fff7a7ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:20.980480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eb43d-c864-46fc-a3bd-562fff7a7ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:20.982206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eb43d-c864-46fc-a3bd-562fff7a7ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:20.983736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eb43d-c864-46fc-a3bd-562fff7a7ddb admin admin] PATH_INFO: `/v3/projects/08625b26363a4896925b82029d5b09c5/users/f3e586802f6d489697b051999f6113b8/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:20.992123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eb43d-c864-46fc-a3bd-562fff7a7ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=08625b26363a4896925b82029d5b09c5, user_id=f3e586802f6d489697b051999f6113b8, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:21.002614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eb43d-c864-46fc-a3bd-562fff7a7ddb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:21.049649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 846/1664] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:20 2022] PUT /identity/v3/projects/08625b26363a4896925b82029d5b09c5/users/f3e586802f6d489697b051999f6113b8/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:21.061688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:21.062001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:21.062313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:21.077128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197531f-f9a3-4ff0-8db7-7f6b75bbdba3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:21.131659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] MFA Rules not processed for user `f3e586802f6d489697b051999f6113b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:21.133199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:21.220463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:21.221119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:21.221406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:21.221673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:21.356855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 847/1665] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:21.375079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:21.376580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:21.415031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:21.419201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:21.424718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:21.449364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 819/1666] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:21.501481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff53f1-4468-4dfb-8805-e5ca437a7ce7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:21.516458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941332c-fdf4-4938-8cfc-bc2174c2d7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:21.516584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941332c-fdf4-4938-8cfc-bc2174c2d7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:21.516912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941332c-fdf4-4938-8cfc-bc2174c2d7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:21.517090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941332c-fdf4-4938-8cfc-bc2174c2d7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:21.556562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941332c-fdf4-4938-8cfc-bc2174c2d7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:21.556562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941332c-fdf4-4938-8cfc-bc2174c2d7c5 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:21.577459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 848/1667] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:21.702700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:21.731917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1246e-ed88-46e3-90a7-2bee14f65a21 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:21.758768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:21.760058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:21.760523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:21.761472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] PATH_INFO: `/v3/users/5b62326fee7542cfaf0fabd3e744dc98` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:21.765179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b62326fee7542cfaf0fabd3e744dc98)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:21.769898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:21.927223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:22.151107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b62326fee7542cfaf0fabd3e744dc98'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:22.292682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b62326fee7542cfaf0fabd3e744dc98'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:22.294944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b62326fee7542cfaf0fabd3e744dc98'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:22.360749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b62326fee7542cfaf0fabd3e744dc98'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:22.401137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b62326fee7542cfaf0fabd3e744dc98'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:22.436061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 820/1668] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:21 2022] DELETE /identity/v3/users/5b62326fee7542cfaf0fabd3e744dc98 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:22.437902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:22.439724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:22.440194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:22.485346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:22.494799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:22.704672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 849/1669] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:22.826430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:22.828479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:23.025997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f39c0-f7e2-4eae-88db-f85547cdd038 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:23.036274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:23.037100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:23.044288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:23.044288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:23.064566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:23.072987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:23.087273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 821/1670] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:23.202475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:24.608586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:24.610947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:24.655800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0da33-a193-4827-ab9a-21e8c9c4db08 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:24.669455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:24.671026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:24.671557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:24.671984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] PATH_INFO: `/v3/projects/87f8cfcf0fbe4659a1e424db6eb07a6a` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:24.676018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f8cfcf0fbe4659a1e424db6eb07a6a)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:24.678916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: WARNING py.warnings [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:26:24.678916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: warnings.warn(msg) Sep 02 21:26:24.678916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: Sep 02 21:26:24.684412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:25.017922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f8cfcf0fbe4659a1e424db6eb07a6a', 'request_id': 'req-d1c67b4c-a873-44f6-9b5b-cc56274c23df'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:25.054513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f8cfcf0fbe4659a1e424db6eb07a6a', 'request_id': 'req-d1c67b4c-a873-44f6-9b5b-cc56274c23df'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:25.111367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f8cfcf0fbe4659a1e424db6eb07a6a', 'request_id': 'req-d1c67b4c-a873-44f6-9b5b-cc56274c23df'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:25.276946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] The token cache is being invalidate because project 87f8cfcf0fbe4659a1e424db6eb07a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:25.287095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:25.287095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:25.287095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 850/1671] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:24 2022] DELETE /identity/v3/projects/87f8cfcf0fbe4659a1e424db6eb07a6a => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:25.291226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:25.320757 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641f813-27be-4e72-a6b0-c35031f54ae5 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:25.522417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:25.523535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:25.524653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:25.525542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] PATH_INFO: `/v3/users/b48661de13b34290aca56dcbd9906ff9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:25.531975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48661de13b34290aca56dcbd9906ff9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:25.538690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:25.955941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48661de13b34290aca56dcbd9906ff9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:26.134349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48661de13b34290aca56dcbd9906ff9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:26.135265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48661de13b34290aca56dcbd9906ff9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:26.173891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48661de13b34290aca56dcbd9906ff9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:26.215515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48661de13b34290aca56dcbd9906ff9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:26.236837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 822/1672] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:25 2022] DELETE /identity/v3/users/b48661de13b34290aca56dcbd9906ff9 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:26.594054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:26.606738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:26.672477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67b4c-a873-44f6-9b5b-cc56274c23df admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:26.794407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:26.906297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:26.907099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:26.907519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:26.907966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] PATH_INFO: `/v3/projects/759ce814453e47b296cfb52b110d90fe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:26.913640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759ce814453e47b296cfb52b110d90fe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:26.918162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:27.147915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759ce814453e47b296cfb52b110d90fe', 'request_id': 'req-619ebaf7-0f5d-4ada-81f7-4acce0385739'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.161705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759ce814453e47b296cfb52b110d90fe', 'request_id': 'req-619ebaf7-0f5d-4ada-81f7-4acce0385739'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.177496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759ce814453e47b296cfb52b110d90fe', 'request_id': 'req-619ebaf7-0f5d-4ada-81f7-4acce0385739'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.324271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] The token cache is being invalidate because project 759ce814453e47b296cfb52b110d90fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:27.324846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.326465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.331238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 851/1673] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:26 2022] DELETE /identity/v3/projects/759ce814453e47b296cfb52b110d90fe => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:27.336163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:27.339617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:27.388179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d881b-0dc8-4e74-ad83-97c73244f936 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:27.493021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:27.574050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:27.574723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:27.575557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:27.575874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] PATH_INFO: `/v3/users/f3e586802f6d489697b051999f6113b8` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:27.585144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e586802f6d489697b051999f6113b8)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:27.587131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:27.913267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e586802f6d489697b051999f6113b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:28.037141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e586802f6d489697b051999f6113b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:28.038086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e586802f6d489697b051999f6113b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:28.065501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e586802f6d489697b051999f6113b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:28.084972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e586802f6d489697b051999f6113b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:28.105362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 823/1674] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:27 2022] DELETE /identity/v3/users/f3e586802f6d489697b051999f6113b8 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:26:28.898753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:28.900500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:28.914866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:28.918663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:28.984805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebaf7-0f5d-4ada-81f7-4acce0385739 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:29.164520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c28ab4-d013-43dc-af5b-839ed863d069 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:29.179216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:29.183503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:29.184023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:29.185087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] PATH_INFO: `/v3/projects/a913231f7477414f963d8255fa52417c` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:29.189525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a913231f7477414f963d8255fa52417c)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:29.194058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:29.194479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:29.195591 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:29.196089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:29.196594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] PATH_INFO: `/v3/users/a159834384664a27963c1209ebdf0c6f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:29.201503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a159834384664a27963c1209ebdf0c6f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:29.215473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:29.572396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a913231f7477414f963d8255fa52417c', 'request_id': 'req-0635e4dc-924d-4766-910e-f190fb2e71c4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.595238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a913231f7477414f963d8255fa52417c', 'request_id': 'req-0635e4dc-924d-4766-910e-f190fb2e71c4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.629854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a159834384664a27963c1209ebdf0c6f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.634598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a159834384664a27963c1209ebdf0c6f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.747662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a913231f7477414f963d8255fa52417c', 'request_id': 'req-0635e4dc-924d-4766-910e-f190fb2e71c4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.763209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] The token cache is being invalidate because project a913231f7477414f963d8255fa52417c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:29.763209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.771469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0635e4dc-924d-4766-910e-f190fb2e71c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.774282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 824/1675] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:28 2022] DELETE /identity/v3/projects/a913231f7477414f963d8255fa52417c => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:29.779497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f788b1-6786-4a85-8c3e-50b8e8afd066 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:29.779787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f788b1-6786-4a85-8c3e-50b8e8afd066 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:29.780061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f788b1-6786-4a85-8c3e-50b8e8afd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:29.848912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a159834384664a27963c1209ebdf0c6f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.850304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a159834384664a27963c1209ebdf0c6f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.866481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c3f788b1-6786-4a85-8c3e-50b8e8afd066 None None] MFA Rules not processed for user `1f12fa71a876411f91c2bbaf3c9080ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:29.867602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c3f788b1-6786-4a85-8c3e-50b8e8afd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:29.869311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:29.879107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c048763d-475f-46d6-8841-465eeccd8905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a159834384664a27963c1209ebdf0c6f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.994918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 852/1676] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:28 2022] DELETE /identity/v3/users/a159834384664a27963c1209ebdf0c6f => generated 0 bytes in 1097 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:29.999904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafaa3e-d9bf-4c4b-aa35-80750f1d37db None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:29.999904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafaa3e-d9bf-4c4b-aa35-80750f1d37db None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.002352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafaa3e-d9bf-4c4b-aa35-80750f1d37db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.014147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 825/1677] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:30.016213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:30.016641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.017625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.059668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:30.064305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:30.075167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9dafaa3e-d9bf-4c4b-aa35-80750f1d37db None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:30.078143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9dafaa3e-d9bf-4c4b-aa35-80750f1d37db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:30.166559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 826/1678] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:30.167509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:30.168845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:30.190580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:30.330240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 853/1679] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:30.341229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:30.341566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.341891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.398682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de29919-9423-448d-bc2e-5f55bb6ef91c None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:30.423423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:30.423423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:30.424105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.425387 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.493950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] MFA Rules not processed for user `ba52c5881d6c42b5ac50272d4bc48ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:30.496295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:30.604018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:30.606484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:30.621877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 827/1680] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:30.623730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:30.625464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:30.657631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 854/1681] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:30.658268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:30.661533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:30.683009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc6d6b-9609-424b-8df3-78f46510ae4d None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:30.720019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:30.721411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:30.727486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.727486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] PATH_INFO: `/v3/projects/08625b26363a4896925b82029d5b09c5` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.727486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=08625b26363a4896925b82029d5b09c5)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:30.727486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:30.800452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e721dc8-634c-4fb3-ae0d-674589ae150d service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:30.812837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d43adb-4b72-452b-9baf-73150550d644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:30.814282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d43adb-4b72-452b-9baf-73150550d644 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:30.814736 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d43adb-4b72-452b-9baf-73150550d644 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.818326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d43adb-4b72-452b-9baf-73150550d644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.846053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d43adb-4b72-452b-9baf-73150550d644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:30.847700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d43adb-4b72-452b-9baf-73150550d644 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:30.874771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 828/1682] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:30.877458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3088-bac1-45fc-9520-d3da96058e65 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:30.877750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3088-bac1-45fc-9520-d3da96058e65 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.879584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3088-bac1-45fc-9520-d3da96058e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.938871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08625b26363a4896925b82029d5b09c5', 'request_id': 'req-fe306594-e1d2-4cc7-966f-b102bae355ce'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.952610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-3d2d3088-bac1-45fc-9520-d3da96058e65 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:30.956090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3d2d3088-bac1-45fc-9520-d3da96058e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:30.960869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08625b26363a4896925b82029d5b09c5', 'request_id': 'req-fe306594-e1d2-4cc7-966f-b102bae355ce'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.995093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08625b26363a4896925b82029d5b09c5', 'request_id': 'req-fe306594-e1d2-4cc7-966f-b102bae355ce'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:31.137065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] The token cache is being invalidate because project 08625b26363a4896925b82029d5b09c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:31.138246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:31.141395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fe306594-e1d2-4cc7-966f-b102bae355ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:31.152774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 855/1683] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:30 2022] DELETE /identity/v3/projects/08625b26363a4896925b82029d5b09c5 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:31.161061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c3e7-857e-4638-903f-fd3cde78cdf6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.161573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c3e7-857e-4638-903f-fd3cde78cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.162068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c3e7-857e-4638-903f-fd3cde78cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.183926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 829/1684] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:31.186385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337845f9-269c-4763-928f-1c5150abcf38 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.186980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337845f9-269c-4763-928f-1c5150abcf38 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.187484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337845f9-269c-4763-928f-1c5150abcf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.222146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-337845f9-269c-4763-928f-1c5150abcf38 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:31.226327 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-337845f9-269c-4763-928f-1c5150abcf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:31.250532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 830/1685] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:31.267075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337845f9-269c-4763-928f-1c5150abcf38 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:31.273367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9657c3e7-857e-4638-903f-fd3cde78cdf6 None None] MFA Rules not processed for user `ba52c5881d6c42b5ac50272d4bc48ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:31.281326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9657c3e7-857e-4638-903f-fd3cde78cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:31.291446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337845f9-269c-4763-928f-1c5150abcf38 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:31.300348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6ab9-bf5d-43ac-b45d-7d8136ec23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:31.301543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6ab9-bf5d-43ac-b45d-7d8136ec23ef admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.302010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6ab9-bf5d-43ac-b45d-7d8136ec23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.302566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6ab9-bf5d-43ac-b45d-7d8136ec23ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.303550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6ab9-bf5d-43ac-b45d-7d8136ec23ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:31.304044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6ab9-bf5d-43ac-b45d-7d8136ec23ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:31.307631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6ab9-bf5d-43ac-b45d-7d8136ec23ef admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:31.327943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 831/1686] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:31.330146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228156-2824-4915-9b21-b8e34c9dfc3e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.330678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228156-2824-4915-9b21-b8e34c9dfc3e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.331119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228156-2824-4915-9b21-b8e34c9dfc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.367542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-50228156-2824-4915-9b21-b8e34c9dfc3e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:31.370688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-50228156-2824-4915-9b21-b8e34c9dfc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:31.387794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 832/1687] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:31.390073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50228156-2824-4915-9b21-b8e34c9dfc3e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:31.421024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50228156-2824-4915-9b21-b8e34c9dfc3e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:31.428846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:31.429984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.430276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.430690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.431556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:31.435694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:31.517122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 856/1688] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:31.524902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c3e7-857e-4638-903f-fd3cde78cdf6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:31.559044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c3e7-857e-4638-903f-fd3cde78cdf6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:31.563900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 833/1689] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:31 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:31.565510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:31.567603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:31.584907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:31.586096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.586215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.586566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.587240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:31.587545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:31.589259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:31.623564 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 857/1690] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:31.624456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:31.650875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8864f9-84d0-4cc1-97da-41e911ad05fa admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:31.797656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8cae-fd08-4bc4-a522-ed98a6f6938b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:31.824179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:31.824850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.825137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.825415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.829151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:31.830105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.830624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.834282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:31.847176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.848504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:31.851083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:31.971588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:31.973265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:31.976941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 858/1691] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:31 2022] POST /identity/v3/users => generated 285 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:31.978857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:31.997461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 834/1692] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:31.999467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.009741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96658d-3213-4018-bc6d-4688a1e9bc4a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.021106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.022068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.022579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.023625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.024513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.026765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.030185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f60ab-9ce9-4263-a639-f001f039bdf3 service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.043529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.046062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.048307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.049334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.051433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.057827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.067678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:32.086907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 835/1693] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:32.094536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.119680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbc1b-2ffc-4ece-bc32-9b50ee3786ad admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.133999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.141450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.141450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.141450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.141450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.141954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.188863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 836/1694] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:32.189481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 859/1695] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:31 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:32.196867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.200223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.249628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043945e0-28ae-443f-8e0d-1047acec49cb admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.356222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:32.380764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6842-b4ed-4e46-b58a-1a861ffbdd89 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.395975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.397174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.397865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.398850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.401600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.405546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eee37-efe2-432f-bc19-87add50b86d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.405546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eee37-efe2-432f-bc19-87add50b86d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.405546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eee37-efe2-432f-bc19-87add50b86d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.406706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.407271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eee37-efe2-432f-bc19-87add50b86d1 admin admin] PATH_INFO: `/v3/projects/19a1e95e7c464d769d1fc7dfa015c4cc/users/782f088123af4783890c7333b192357c/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.444972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eee37-efe2-432f-bc19-87add50b86d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a1e95e7c464d769d1fc7dfa015c4cc, user_id=782f088123af4783890c7333b192357c, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.450398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eee37-efe2-432f-bc19-87add50b86d1 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.559933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 860/1696] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/users => generated 281 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:32.564441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.597228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd51172-6fa3-4aa4-987d-e2132282ab3b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.601906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 837/1697] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:32 2022] PUT /identity/v3/projects/19a1e95e7c464d769d1fc7dfa015c4cc/users/782f088123af4783890c7333b192357c/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:32.614064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a486-2d1c-49c0-aa7a-8fe56503ebf0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.614771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a486-2d1c-49c0-aa7a-8fe56503ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.614771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a486-2d1c-49c0-aa7a-8fe56503ebf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.654953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-49a6a486-2d1c-49c0-aa7a-8fe56503ebf0 None None] MFA Rules not processed for user `782f088123af4783890c7333b192357c`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:32.656282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-49a6a486-2d1c-49c0-aa7a-8fe56503ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:32.798582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b377b-74c2-43bd-a73a-7fedef4103b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.799467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b377b-74c2-43bd-a73a-7fedef4103b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.799960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b377b-74c2-43bd-a73a-7fedef4103b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.800414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b377b-74c2-43bd-a73a-7fedef4103b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.801384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b377b-74c2-43bd-a73a-7fedef4103b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.804901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b377b-74c2-43bd-a73a-7fedef4103b7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.839003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 838/1698] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:32.847050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a567c1-e0d9-421e-bba9-f1e1292487e0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.847330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a567c1-e0d9-421e-bba9-f1e1292487e0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.848165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a567c1-e0d9-421e-bba9-f1e1292487e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.864559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 861/1699] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:32.864559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48d5b-eefd-473b-ba54-d8183397aa83 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.865044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48d5b-eefd-473b-ba54-d8183397aa83 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.866991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48d5b-eefd-473b-ba54-d8183397aa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.940253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-13a567c1-e0d9-421e-bba9-f1e1292487e0 None None] MFA Rules not processed for user `fa44c485963e4c3f9f26e36ba7d99d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:32.942024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-13a567c1-e0d9-421e-bba9-f1e1292487e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:32.961413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b4e48d5b-eefd-473b-ba54-d8183397aa83 None None] MFA Rules not processed for user `e4ee406036b54e8f862cbcc942fc985b`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:32.963114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b4e48d5b-eefd-473b-ba54-d8183397aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:33.181432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 839/1700] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:33.182289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 862/1701] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:33.183833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a567c1-e0d9-421e-bba9-f1e1292487e0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.185897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e48d5b-eefd-473b-ba54-d8183397aa83 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.217902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a567c1-e0d9-421e-bba9-f1e1292487e0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.220205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e48d5b-eefd-473b-ba54-d8183397aa83 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.228617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.232028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.233220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.234956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.236291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.238912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5fd9-9ba2-44c0-84ae-ce0eba1d5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.239677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5fd9-9ba2-44c0-84ae-ce0eba1d5bbe admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.240076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5fd9-9ba2-44c0-84ae-ce0eba1d5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.240453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5fd9-9ba2-44c0-84ae-ce0eba1d5bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.241346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd5fd9-9ba2-44c0-84ae-ce0eba1d5bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.243061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd5fd9-9ba2-44c0-84ae-ce0eba1d5bbe admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.249729 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.275170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 863/1702] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:33.277098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.279257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.281099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.318530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] MFA Rules not processed for user `fa44c485963e4c3f9f26e36ba7d99d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:33.320523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:33.332795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 864/1703] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:33.332795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.340267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:33.412916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:33.414446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 840/1704] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:33 2022] POST /identity/v3/projects => generated 369 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:33.415776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.597564 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705e9c0-9e3c-4b2e-9549-ee84b0a32ceb None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.646889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1c1c9-2cdc-4511-8a18-084a2bd76d7f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.675997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.675997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.675997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.676655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] PATH_INFO: `/v3/projects/a5ffd70926c5400c85042974da129401/users/e4d0b48c9f8c4f0fac5804b42e49d430/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.724245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ffd70926c5400c85042974da129401, user_id=e4d0b48c9f8c4f0fac5804b42e49d430, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.726871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.753697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe54cd-9294-400f-91e7-ee8185c23774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.754907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe54cd-9294-400f-91e7-ee8185c23774 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.758607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe54cd-9294-400f-91e7-ee8185c23774 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.758607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe54cd-9294-400f-91e7-ee8185c23774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.839170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 841/1705] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:33 2022] PUT /identity/v3/projects/a5ffd70926c5400c85042974da129401/users/e4d0b48c9f8c4f0fac5804b42e49d430/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:33.839170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.892595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe54cd-9294-400f-91e7-ee8185c23774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.900549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe54cd-9294-400f-91e7-ee8185c23774 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.946925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 865/1706] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:33.970520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78347-a97b-478a-ab48-30b1fc7f8004 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.971199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78347-a97b-478a-ab48-30b1fc7f8004 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.971686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78347-a97b-478a-ab48-30b1fc7f8004 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.974480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 866/1707] 10.222.0.71 () {54 vars in 912 bytes} [Fri Sep 2 21:26:33 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:33.981327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f78347-a97b-478a-ab48-30b1fc7f8004 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.992055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-09f78347-a97b-478a-ab48-30b1fc7f8004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:34.033506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641a00d-ec5d-4cf2-913e-9625a9a4f36d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:34.039994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceced446-66f2-4a92-8508-516de056fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:34.040987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceced446-66f2-4a92-8508-516de056fcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.041581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceced446-66f2-4a92-8508-516de056fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.042026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceced446-66f2-4a92-8508-516de056fcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.043230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceced446-66f2-4a92-8508-516de056fcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:34.046654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceced446-66f2-4a92-8508-516de056fcf8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:34.171917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 842/1708] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:33 2022] POST /identity/v3/users => generated 291 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:34.176439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947375e-38a2-478c-a46e-8c34d05ca3a4 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.177042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947375e-38a2-478c-a46e-8c34d05ca3a4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.177327 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947375e-38a2-478c-a46e-8c34d05ca3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.241687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f78347-a97b-478a-ab48-30b1fc7f8004 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:34.270578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:34.273754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.276111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.277126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] PATH_INFO: `/v3/projects/55a1a6fc049741acb6d1d407a3162330` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.278077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f947375e-38a2-478c-a46e-8c34d05ca3a4 None None] MFA Rules not processed for user `e4d0b48c9f8c4f0fac5804b42e49d430`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:34.281693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f947375e-38a2-478c-a46e-8c34d05ca3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:34.282587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a1a6fc049741acb6d1d407a3162330)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:34.285944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:34.384998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:34.501731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 843/1709] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:34.517395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.517742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.518020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.564523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a1a6fc049741acb6d1d407a3162330', 'request_id': 'req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:34.576985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a1a6fc049741acb6d1d407a3162330', 'request_id': 'req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:34.596106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a1a6fc049741acb6d1d407a3162330', 'request_id': 'req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:34.614889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] MFA Rules not processed for user `9a588483344147629a6f557a54c34c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:34.617344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:34.734345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] The token cache is being invalidate because project 55a1a6fc049741acb6d1d407a3162330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:34.734800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:34.737404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:34.743410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 867/1710] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:33 2022] DELETE /identity/v3/projects/55a1a6fc049741acb6d1d407a3162330 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:34.749646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:34.754058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:34.784393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 844/1711] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:34.784393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:34.786001 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:34.914188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56e676-02cb-4d74-9dab-6f9a6bb10da1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:34.941337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:34.941983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.942270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.942403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b81c90-ceb3-4ed4-9194-d2e0be202e8f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:34.943197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.949355 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:34.976075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4e0d-bc41-477e-816c-0625b3a7731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:34.976755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4e0d-bc41-477e-816c-0625b3a7731d admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.977062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4e0d-bc41-477e-816c-0625b3a7731d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.977337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4e0d-bc41-477e-816c-0625b3a7731d admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.977986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4e0d-bc41-477e-816c-0625b3a7731d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:34.979625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4e0d-bc41-477e-816c-0625b3a7731d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:35.035168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 868/1712] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:35.036581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae7a1-7be1-42b1-846f-95b053a584fc None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.036903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae7a1-7be1-42b1-846f-95b053a584fc None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.037180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae7a1-7be1-42b1-846f-95b053a584fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.096237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:35.098069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:35.113014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 845/1713] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:35.113975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:35.115485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:35.176978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-39dae7a1-7be1-42b1-846f-95b053a584fc None None] MFA Rules not processed for user `e43f913fbce54697b3261efc93ad9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:35.178612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-39dae7a1-7be1-42b1-846f-95b053a584fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:35.272120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce16da-10c3-4cc1-a180-ab495f8395ac service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:35.277785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:35.278465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.279554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.279554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.282161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:35.429207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:35.455972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 869/1714] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:35.455972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173752ec-4641-4949-8b6e-d26e9092da0c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.471492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173752ec-4641-4949-8b6e-d26e9092da0c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.471492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173752ec-4641-4949-8b6e-d26e9092da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.501666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:35.504598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:35.521113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-173752ec-4641-4949-8b6e-d26e9092da0c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:35.522434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-173752ec-4641-4949-8b6e-d26e9092da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:35.523035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 846/1715] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:35.523916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:35.525799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:35.563614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3ac15-84c8-40d9-b55d-2025112c1a46 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:35.564097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 870/1716] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:35.565015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173752ec-4641-4949-8b6e-d26e9092da0c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:35.577969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:35.580922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.581212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.581486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.583242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173752ec-4641-4949-8b6e-d26e9092da0c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:35.597467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243569-d14a-4b48-88f8-af00d51550e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:35.597806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243569-d14a-4b48-88f8-af00d51550e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.598160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243569-d14a-4b48-88f8-af00d51550e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.598926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243569-d14a-4b48-88f8-af00d51550e9 admin admin] PATH_INFO: `/v3/projects/d35e5d7fb89848bd84e1a28a17f31f1e/users/ca36e0aae0894f1cb21527622ed0240b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.616793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:35.618370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:35.635991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 847/1717] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:35.637027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:35.639672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243569-d14a-4b48-88f8-af00d51550e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35e5d7fb89848bd84e1a28a17f31f1e, user_id=ca36e0aae0894f1cb21527622ed0240b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:35.639846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:35.643874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243569-d14a-4b48-88f8-af00d51550e9 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:35.671618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f252-654f-420d-b2fd-5181b54c1bea service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:35.683787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:35.684483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.684786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.685635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] PATH_INFO: `/v3/users/e4d0b48c9f8c4f0fac5804b42e49d430` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.697735 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d0b48c9f8c4f0fac5804b42e49d430)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:35.699895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:35.744902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 871/1718] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:35 2022] PUT /identity/v3/projects/d35e5d7fb89848bd84e1a28a17f31f1e/users/ca36e0aae0894f1cb21527622ed0240b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:35.744902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f656cc-1fa2-403f-9cb7-598494fd9ba0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.744902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f656cc-1fa2-403f-9cb7-598494fd9ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.744902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f656cc-1fa2-403f-9cb7-598494fd9ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.796480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-48f656cc-1fa2-403f-9cb7-598494fd9ba0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:35.797235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:35.800217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-48f656cc-1fa2-403f-9cb7-598494fd9ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:35.949019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 872/1719] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:35.951406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f656cc-1fa2-403f-9cb7-598494fd9ba0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:35.986091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f656cc-1fa2-403f-9cb7-598494fd9ba0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:35.988000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d0b48c9f8c4f0fac5804b42e49d430'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:36.003096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:36.006279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.006983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.011426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.012610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:36.023250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:36.063745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 873/1720] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:36.063745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:36.098185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d0b48c9f8c4f0fac5804b42e49d430'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:36.099466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d0b48c9f8c4f0fac5804b42e49d430'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:36.101580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9189c-552e-41f6-9a91-b5d07527ed08 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:36.111048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:36.111919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.112453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.113052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.113929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:36.114459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:36.117213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:36.126086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d0b48c9f8c4f0fac5804b42e49d430'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:36.141804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d0b48c9f8c4f0fac5804b42e49d430'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:36.152492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 874/1721] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:36.154168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:36.156516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:36.161810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 848/1722] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:35 2022] DELETE /identity/v3/users/e4d0b48c9f8c4f0fac5804b42e49d430 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:36.162775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:36.166643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:36.180482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d919eb-5c36-4cdf-8bc2-47f07d941760 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:36.317489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c9db6-14ca-4742-a469-6d74d248ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:36.318385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c9db6-14ca-4742-a469-6d74d248ceb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.318787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c9db6-14ca-4742-a469-6d74d248ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.319221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c9db6-14ca-4742-a469-6d74d248ceb1 admin admin] PATH_INFO: `/v3/projects/d35e5d7fb89848bd84e1a28a17f31f1e/users/ca36e0aae0894f1cb21527622ed0240b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.329245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c9db6-14ca-4742-a469-6d74d248ceb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35e5d7fb89848bd84e1a28a17f31f1e, user_id=ca36e0aae0894f1cb21527622ed0240b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:36.337675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c9db6-14ca-4742-a469-6d74d248ceb1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:36.341968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5f1b5-44c2-426e-bdb3-a5c424e784d9 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:36.352714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d843f5-b899-44f7-8162-6bd2f2636145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:36.353522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d843f5-b899-44f7-8162-6bd2f2636145 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.353810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d843f5-b899-44f7-8162-6bd2f2636145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.355019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d843f5-b899-44f7-8162-6bd2f2636145 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.357198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d843f5-b899-44f7-8162-6bd2f2636145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:36.362663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d843f5-b899-44f7-8162-6bd2f2636145 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:36.370789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 875/1723] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:36 2022] PUT /identity/v3/projects/d35e5d7fb89848bd84e1a28a17f31f1e/users/ca36e0aae0894f1cb21527622ed0240b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:36.372968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566118-5d36-45d1-854d-f399898f4056 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.373264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566118-5d36-45d1-854d-f399898f4056 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.373534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566118-5d36-45d1-854d-f399898f4056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.423200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6b566118-5d36-45d1-854d-f399898f4056 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:36.424559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6b566118-5d36-45d1-854d-f399898f4056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:36.575287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 849/1724] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:36 2022] POST /identity/v3/projects => generated 393 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:36.579333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eb90f-cc1c-403d-b6a7-2a4e1c5495d5 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.580047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eb90f-cc1c-403d-b6a7-2a4e1c5495d5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.580690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eb90f-cc1c-403d-b6a7-2a4e1c5495d5 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.584571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 850/1725] 10.222.0.71 () {54 vars in 912 bytes} [Fri Sep 2 21:26:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:36.586870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc9cd8-49bf-49f2-96bb-7384c277aeca None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.587674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc9cd8-49bf-49f2-96bb-7384c277aeca None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.588716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc9cd8-49bf-49f2-96bb-7384c277aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.606693 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 876/1726] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:36.619674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566118-5d36-45d1-854d-f399898f4056 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:36.653378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566118-5d36-45d1-854d-f399898f4056 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:36.750767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-77cc9cd8-49bf-49f2-96bb-7384c277aeca None None] MFA Rules not processed for user `ca36e0aae0894f1cb21527622ed0240b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:36.759278 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-77cc9cd8-49bf-49f2-96bb-7384c277aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:36.936277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:36.938550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:36.939944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.940427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.942806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.944033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:36.949680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:37.031361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 851/1727] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:37.033526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.034068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.034483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:37.092947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] MFA Rules not processed for user `9a588483344147629a6f557a54c34c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:37.099499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:37.111506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 877/1728] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:36 2022] POST /identity/v3/users => generated 297 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:37.114484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:37.125566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:37.309411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 852/1729] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:37.311093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:37.312882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:37.335169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dac92-c640-46e8-99c3-28e8d1b2b0d0 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:37.346535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:37.351906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.352218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.352927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:37.402451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:37.402451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:37.413654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 878/1730] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:37.414738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:37.419913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:37.424291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:37.525522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0678e9-55b4-401b-ade5-8653f03c6d11 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:37.545693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:37.546529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.546896 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.546896 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:37.553994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:37.644590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f748-398a-49bc-a64b-f605ba932656 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:37.662241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:37.663046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.663472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.664059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:37.666580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:37.682285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:37.684522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:37.699326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 879/1731] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:37.701329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:37.706131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:37.721416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:37.721416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:37.751841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 853/1732] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:37.753380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:37.790085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0791-f9c8-408e-91a6-ccf7225d0d13 service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:37.808853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:37.809395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.810496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.810978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:37.812444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:37.814907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:37.840776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9bb5e-56cb-4421-8267-7310699b24f4 service placement] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:37.854668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dac045-c7f4-4a57-bf5f-bd89bc8fc74d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:37.856373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dac045-c7f4-4a57-bf5f-bd89bc8fc74d service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.860284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dac045-c7f4-4a57-bf5f-bd89bc8fc74d service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.860779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dac045-c7f4-4a57-bf5f-bd89bc8fc74d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:37.881589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 854/1733] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:37.881589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:37.918939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dac045-c7f4-4a57-bf5f-bd89bc8fc74d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:37.930106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e9390-0034-44f8-9615-49ffbb7f5e7a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:37.932980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dac045-c7f4-4a57-bf5f-bd89bc8fc74d service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:37.953803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:37.954602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.954981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.955373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:37.963929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 880/1734] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:37.965497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862736-8c32-4bcf-9963-442ba760a3b0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:37.968500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862736-8c32-4bcf-9963-442ba760a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:37.968898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862736-8c32-4bcf-9963-442ba760a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:38.014208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:38.016323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:38.023640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a4862736-8c32-4bcf-9963-442ba760a3b0 None None] MFA Rules not processed for user `1f12fa71a876411f91c2bbaf3c9080ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:38.031739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a4862736-8c32-4bcf-9963-442ba760a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:38.057838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 855/1735] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:38.059083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:38.096432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da9ab-8c91-4f0f-9e40-210189fb86bd service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:38.104840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd32aa-c4a9-4fb7-af39-861ac377d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:38.107208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd32aa-c4a9-4fb7-af39-861ac377d51a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:38.107695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd32aa-c4a9-4fb7-af39-861ac377d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:38.108113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd32aa-c4a9-4fb7-af39-861ac377d51a admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:38.109416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd32aa-c4a9-4fb7-af39-861ac377d51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:38.115416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd32aa-c4a9-4fb7-af39-861ac377d51a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:38.150232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 881/1736] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:38.163548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 856/1737] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:38.163716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862736-8c32-4bcf-9963-442ba760a3b0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:38.184415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862736-8c32-4bcf-9963-442ba760a3b0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:38.195511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:38.196601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:38.197111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:38.197592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] PATH_INFO: `/v3/projects/68db6015431a4a599b23041186fc7548/users/3cebf0cc7e484c898ee4adcdd213e163/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:38.231377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68db6015431a4a599b23041186fc7548, user_id=3cebf0cc7e484c898ee4adcdd213e163, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:38.235801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:38.395787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 882/1738] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:38 2022] PUT /identity/v3/projects/68db6015431a4a599b23041186fc7548/users/3cebf0cc7e484c898ee4adcdd213e163/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:38.411814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:38.412645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:38.412645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:38.495640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] MFA Rules not processed for user `3cebf0cc7e484c898ee4adcdd213e163`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:38.499096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:38.695829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 857/1739] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:38.697037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:38.917473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:38.923306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:38.932310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ee253-0493-4db7-9b7a-4da96d68fc98 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:38.943890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:38.944640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:38.945328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:38.945695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:38.946810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:38.949249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:38.969626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849d23-f4b3-465d-b837-3c28f46cd0ca None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:38.975697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:38.976361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:38.982869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:38.982869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] PATH_INFO: `/v3/projects/a5ffd70926c5400c85042974da129401` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:38.982869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ffd70926c5400c85042974da129401)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:38.982869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:39.064320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:39.164048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 883/1740] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:38 2022] POST /identity/v3/projects => generated 391 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:39.166110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.184868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ffd70926c5400c85042974da129401', 'request_id': 'req-359d9538-d7b6-49a6-b6cd-2f5734dad251'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:39.190190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ffd70926c5400c85042974da129401', 'request_id': 'req-359d9538-d7b6-49a6-b6cd-2f5734dad251'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:39.306980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21585bdf-d096-48f0-bc08-cc0776e635af admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:39.321009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ffd70926c5400c85042974da129401', 'request_id': 'req-359d9538-d7b6-49a6-b6cd-2f5734dad251'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:39.331365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:39.333916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.334206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.334487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.335153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:39.337307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:39.405464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] The token cache is being invalidate because project a5ffd70926c5400c85042974da129401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:39.407453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:39.409143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-359d9538-d7b6-49a6-b6cd-2f5734dad251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:39.413142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 858/1741] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:38 2022] DELETE /identity/v3/projects/a5ffd70926c5400c85042974da129401 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:39.421836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66987f1-22b5-4b2f-b74b-7b6ee1a971ff None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.422820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66987f1-22b5-4b2f-b74b-7b6ee1a971ff None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.423980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66987f1-22b5-4b2f-b74b-7b6ee1a971ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.464543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 884/1742] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:39 2022] POST /identity/v3/users => generated 302 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:39.470408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.473604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f66987f1-22b5-4b2f-b74b-7b6ee1a971ff None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:39.473978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:39.478006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f66987f1-22b5-4b2f-b74b-7b6ee1a971ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:39.505486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 859/1743] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:39.527693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54046-0f18-497e-94e7-a5f34f871c40 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.528359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54046-0f18-497e-94e7-a5f34f871c40 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.529014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54046-0f18-497e-94e7-a5f34f871c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.542002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761631e-110e-4822-8b3c-a9486374e806 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:39.558485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:39.559120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.559401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.559683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.572379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:39.574089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:39.578145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-33b54046-0f18-497e-94e7-a5f34f871c40 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:39.580494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-33b54046-0f18-497e-94e7-a5f34f871c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:39.609193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 860/1744] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:39.609358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 885/1745] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:39.613940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.616186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54046-0f18-497e-94e7-a5f34f871c40 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.639225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54046-0f18-497e-94e7-a5f34f871c40 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:39.645822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:39.646649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.647007 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.647242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] PATH_INFO: `/v3/projects/4f23f3bc1ffb4cceb31eef75b90c7d41/users/8fe42ae911d14bc78be3fa749abdbf4f/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.660313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8630e-ced9-4864-ae32-c2c2a5475f39 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:39.668985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f23f3bc1ffb4cceb31eef75b90c7d41, user_id=8fe42ae911d14bc78be3fa749abdbf4f, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:39.674152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:39.701886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:39.701886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.701886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.701886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.702617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:39.703373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:39.705398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:39.733164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 886/1746] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:39.738901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.762613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c8fdd-02a7-45dd-b34f-b1345d94f27a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:39.769742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ad83-911b-4868-b6fe-f1638a5756a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:39.777484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ad83-911b-4868-b6fe-f1638a5756a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.777484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ad83-911b-4868-b6fe-f1638a5756a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.777484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ad83-911b-4868-b6fe-f1638a5756a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.777484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ad83-911b-4868-b6fe-f1638a5756a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:39.777484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ad83-911b-4868-b6fe-f1638a5756a2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:39.807961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 861/1747] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:39 2022] PUT /identity/v3/projects/4f23f3bc1ffb4cceb31eef75b90c7d41/users/8fe42ae911d14bc78be3fa749abdbf4f/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:39.812420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.955933 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:40.014468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 887/1748] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:39 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:40.021109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ddf5d-3d9e-4925-99ff-712557efa291 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.025415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ddf5d-3d9e-4925-99ff-712557efa291 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.025957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ddf5d-3d9e-4925-99ff-712557efa291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.062489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767fe1-407a-4db4-be1b-2c8ca5f424a8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.111362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c41ddf5d-3d9e-4925-99ff-712557efa291 None None] MFA Rules not processed for user `fa44c485963e4c3f9f26e36ba7d99d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:40.113201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c41ddf5d-3d9e-4925-99ff-712557efa291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:40.242410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.243589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.250545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.251372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.252328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:40.255410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:40.274381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 862/1749] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:40.275944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:40.297217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e381-185e-45e0-b797-b6b0718c08f2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.308867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 888/1750] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:40.308867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ddf5d-3d9e-4925-99ff-712557efa291 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:40.311048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.312164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.317046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.317046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.317046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:40.317046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:40.321669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ddf5d-3d9e-4925-99ff-712557efa291 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.332587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910c5cd-634a-4ac1-ba62-407e9671a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.333305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c5cd-634a-4ac1-ba62-407e9671a508 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.333876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c5cd-634a-4ac1-ba62-407e9671a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.333876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c5cd-634a-4ac1-ba62-407e9671a508 admin admin] PATH_INFO: `/v3/projects/4f23f3bc1ffb4cceb31eef75b90c7d41/users/8fe42ae911d14bc78be3fa749abdbf4f/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.338625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910c5cd-634a-4ac1-ba62-407e9671a508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f23f3bc1ffb4cceb31eef75b90c7d41, user_id=8fe42ae911d14bc78be3fa749abdbf4f, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:40.361523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910c5cd-634a-4ac1-ba62-407e9671a508 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:40.389997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 889/1751] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:40 2022] PUT /identity/v3/projects/4f23f3bc1ffb4cceb31eef75b90c7d41/users/8fe42ae911d14bc78be3fa749abdbf4f/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:40.406318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.406687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.406955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.469927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 863/1752] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:40 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:40.474807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:40.537012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a982485-bf08-4cf6-9b84-ad37dd3ffff3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.554827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] MFA Rules not processed for user `8fe42ae911d14bc78be3fa749abdbf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:40.563320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:40.728973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 890/1753] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:40.740916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:40.747901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:40.896981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.897653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.897939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.899459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.899830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:40.906650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:40.937394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 864/1754] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:40.941054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:40.958876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14059123-5811-4d42-81a2-4561eae927e6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.966566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded57573-1e47-4eff-b571-9d6764773ce0 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.976198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.979780 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.980180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.980664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.981497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.982452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.984771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.985155 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.985957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:40.991886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:41.001454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:41.003042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:41.026004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 865/1755] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:41.028531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:41.049297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 891/1756] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:41.069172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12163-b4f8-4a0b-b6a7-a60ec1da7c37 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:41.077422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91b7cc-eca1-4f0e-9709-99a4e214b8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:41.078537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b7cc-eca1-4f0e-9709-99a4e214b8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:41.079066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b7cc-eca1-4f0e-9709-99a4e214b8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:41.079697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b7cc-eca1-4f0e-9709-99a4e214b8e9 admin admin] PATH_INFO: `/v3/projects/fa5216fc30554cf599dbe62f4ab056d9/users/6f1b3cab2ba24bf3a418128a9a3e8149/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:41.125811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91b7cc-eca1-4f0e-9709-99a4e214b8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5216fc30554cf599dbe62f4ab056d9, user_id=6f1b3cab2ba24bf3a418128a9a3e8149, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:41.132236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91b7cc-eca1-4f0e-9709-99a4e214b8e9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:41.243763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:41.261820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e934b-50c8-499e-bf01-78dae9c3888e service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:41.304286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:41.322312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 866/1757] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:41 2022] PUT /identity/v3/projects/fa5216fc30554cf599dbe62f4ab056d9/users/6f1b3cab2ba24bf3a418128a9a3e8149/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:41.324592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:41.324962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:41.325310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:41.327082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017a6ea-97e4-4d6b-97ad-34871394b06f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:41.327367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017a6ea-97e4-4d6b-97ad-34871394b06f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:41.327642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017a6ea-97e4-4d6b-97ad-34871394b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:41.331954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:41.465671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1017a6ea-97e4-4d6b-97ad-34871394b06f None None] MFA Rules not processed for user `6f1b3cab2ba24bf3a418128a9a3e8149`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:41.467520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1017a6ea-97e4-4d6b-97ad-34871394b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:41.523292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:41.524932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:41.562767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 892/1758] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:41.742348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 867/1759] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:41.746594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:41.770408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180d60-bbd7-4de7-8fe1-8f523954eb97 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:41.848677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6c97a-b4b6-4292-9ff2-027343de9d80 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:41.849104 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6c97a-b4b6-4292-9ff2-027343de9d80 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:41.849371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6c97a-b4b6-4292-9ff2-027343de9d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:41.959246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a3a6c97a-b4b6-4292-9ff2-027343de9d80 None None] MFA Rules not processed for user `e4ee406036b54e8f862cbcc942fc985b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:41.961243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a3a6c97a-b4b6-4292-9ff2-027343de9d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:42.063365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:42.068418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:42.069124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:42.070562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:42.076120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:42.085437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:42.233101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 868/1760] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:42.318986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 893/1761] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:41 2022] POST /identity/v3/projects => generated 375 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:42.324182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6c97a-b4b6-4292-9ff2-027343de9d80 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:42.349757 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6c97a-b4b6-4292-9ff2-027343de9d80 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:42.513825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:42.514535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:42.514879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:42.515217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:42.515953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:42.531520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:42.773740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 869/1762] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:42 2022] POST /identity/v3/users => generated 288 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:42.778752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:42.835058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d16f96-c313-49ae-b698-ac515a2c5b94 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:42.858969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:42.861881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:42.863386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:42.863694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:42.868245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:42.873337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:42.878751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:42.944836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 894/1763] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:42.949159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:42.979008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abb573-7e15-4419-80b1-c616569ad69d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:43.012671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad4599-7a62-4e83-a502-2eb77ad00bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:43.014884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4599-7a62-4e83-a502-2eb77ad00bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.019706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4599-7a62-4e83-a502-2eb77ad00bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.022564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4599-7a62-4e83-a502-2eb77ad00bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.026531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad4599-7a62-4e83-a502-2eb77ad00bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:43.039682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad4599-7a62-4e83-a502-2eb77ad00bf2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:43.097614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 870/1764] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:43.098900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:43.125403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76b28-ff7d-492c-abb5-bf9200fa6e8a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:43.131631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeab012-dcc6-41bd-b9e4-38d969e0f5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:43.132275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab012-dcc6-41bd-b9e4-38d969e0f5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.132892 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab012-dcc6-41bd-b9e4-38d969e0f5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.133337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab012-dcc6-41bd-b9e4-38d969e0f5bb admin admin] PATH_INFO: `/v3/projects/2d94884a6e864ad4aa019b73e9e61033/users/fceeae502696410e8c2bd652249fef21/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.159113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:43.177001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeab012-dcc6-41bd-b9e4-38d969e0f5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d94884a6e864ad4aa019b73e9e61033, user_id=fceeae502696410e8c2bd652249fef21, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:43.183463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeab012-dcc6-41bd-b9e4-38d969e0f5bb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:43.325095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 895/1765] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:43 2022] PUT /identity/v3/projects/2d94884a6e864ad4aa019b73e9e61033/users/fceeae502696410e8c2bd652249fef21/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:43.355699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a6165-84b5-4c79-b3f7-0071fcbb2c62 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.355985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a6165-84b5-4c79-b3f7-0071fcbb2c62 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.358516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a6165-84b5-4c79-b3f7-0071fcbb2c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.359473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39da4-2fe0-427e-aa5a-e6ae05e832a0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.359814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39da4-2fe0-427e-aa5a-e6ae05e832a0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.362430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39da4-2fe0-427e-aa5a-e6ae05e832a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.457901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a7e39da4-2fe0-427e-aa5a-e6ae05e832a0 None None] MFA Rules not processed for user `e43f913fbce54697b3261efc93ad9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:43.458654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6d4a6165-84b5-4c79-b3f7-0071fcbb2c62 None None] MFA Rules not processed for user `fceeae502696410e8c2bd652249fef21`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:43.459974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6d4a6165-84b5-4c79-b3f7-0071fcbb2c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:43.463715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a7e39da4-2fe0-427e-aa5a-e6ae05e832a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:43.688227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 896/1766] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:43.710371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 871/1767] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:43.720857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e39da4-2fe0-427e-aa5a-e6ae05e832a0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:43.839332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:43.897944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e39da4-2fe0-427e-aa5a-e6ae05e832a0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:43.911707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:43.912466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.912677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.913203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.914145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:43.925762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:44.135599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 897/1768] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:43 2022] POST /identity/v3/projects => generated 375 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:44.141540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a6165-84b5-4c79-b3f7-0071fcbb2c62 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:44.173351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a6165-84b5-4c79-b3f7-0071fcbb2c62 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:44.369271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:44.372946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:44.453268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:44.453372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.453645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.453926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.454585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:44.459961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:44.486328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e76f9-7e6b-4d79-a517-159a30266136 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:44.497928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:44.498866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.499354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.499857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] PATH_INFO: `/v3/users/782f088123af4783890c7333b192357c` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.501521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782f088123af4783890c7333b192357c)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:44.506894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:44.623815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 872/1769] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:44 2022] POST /identity/v3/users => generated 294 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:44.631935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:44.698956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd20d-3b56-4bae-acfa-a373bdf2f172 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:44.735324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:44.736376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.736899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.737388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.738808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:44.759153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:44.817239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 873/1770] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:44.818754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:44.896558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2649-5847-4c1c-a742-8ebe4d1800d6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:44.917645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:44.919961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.920258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.920543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] PATH_INFO: `/v3/projects/bb511baa3d9644f0b60cd132978b7597/users/ac8fe709164c42609c30f3dd5e2b3c08/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.923659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782f088123af4783890c7333b192357c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:44.925591 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782f088123af4783890c7333b192357c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:44.957972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb511baa3d9644f0b60cd132978b7597, user_id=ac8fe709164c42609c30f3dd5e2b3c08, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:44.961991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:45.049831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782f088123af4783890c7333b192357c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:45.051680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782f088123af4783890c7333b192357c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:45.065035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4379b556-6987-46cc-afec-9ac8d3d04ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782f088123af4783890c7333b192357c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:45.116393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 874/1771] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:44 2022] PUT /identity/v3/projects/bb511baa3d9644f0b60cd132978b7597/users/ac8fe709164c42609c30f3dd5e2b3c08/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:45.117525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:45.126693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:45.360639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 898/1772] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:44 2022] DELETE /identity/v3/users/782f088123af4783890c7333b192357c => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:45.361955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fba4e-73ad-44d0-bc10-f4889b101331 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:45.376375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13170-7e4f-41f9-a8ad-66c85b9814f5 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.376375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13170-7e4f-41f9-a8ad-66c85b9814f5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.376375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13170-7e4f-41f9-a8ad-66c85b9814f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.450805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a1e13170-7e4f-41f9-a8ad-66c85b9814f5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:45.450805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a1e13170-7e4f-41f9-a8ad-66c85b9814f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:45.557408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb7588-403c-4509-b56b-3f4bea2f1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:45.557408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb7588-403c-4509-b56b-3f4bea2f1952 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.557408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb7588-403c-4509-b56b-3f4bea2f1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.557408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb7588-403c-4509-b56b-3f4bea2f1952 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.558216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb7588-403c-4509-b56b-3f4bea2f1952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:45.558216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb7588-403c-4509-b56b-3f4bea2f1952 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:45.566699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 875/1773] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:45.568593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4916-f7d8-4663-a357-70131df1bdac None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.569012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4916-f7d8-4663-a357-70131df1bdac None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.569245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4916-f7d8-4663-a357-70131df1bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.620013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 899/1774] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:45.621231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e13170-7e4f-41f9-a8ad-66c85b9814f5 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:45.645030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e13170-7e4f-41f9-a8ad-66c85b9814f5 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:45.665878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:45.665878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.666908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.667671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] PATH_INFO: `/v3/projects/bb511baa3d9644f0b60cd132978b7597/users/ac8fe709164c42609c30f3dd5e2b3c08/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.677507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb511baa3d9644f0b60cd132978b7597, user_id=ac8fe709164c42609c30f3dd5e2b3c08, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:45.682616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:45.729449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 900/1775] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:45 2022] PUT /identity/v3/projects/bb511baa3d9644f0b60cd132978b7597/users/ac8fe709164c42609c30f3dd5e2b3c08/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:45.731909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:45.735097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:45.739427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-632e4916-f7d8-4663-a357-70131df1bdac None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:45.746198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-632e4916-f7d8-4663-a357-70131df1bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:45.868091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 876/1776] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:45.869510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.869855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.870261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.875941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4e088-6d35-49d8-9d35-f2b65ec1a829 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:45.880387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:45.881131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.881480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.882582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.916971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] MFA Rules not processed for user `ac8fe709164c42609c30f3dd5e2b3c08`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:45.918262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:45.990925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:45.992814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:46.016382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 901/1777] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:46.026492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 877/1778] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:46.036665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:46.038223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:46.105091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664100a-cc50-4b24-bf44-3a7dc0bdaff2 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:46.109356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:46.109969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:46.110270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:46.110513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:46.112699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:46.196426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:46.197355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:46.208687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 902/1779] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:48.304100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:48.674132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:48.676413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:48.971927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcdb50-c93f-444e-8c8d-2fa378ca5580 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:48.979060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:48.979663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:48.980017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:48.980399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:49.001929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:49.004417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:49.025000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:49.027582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:49.036193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 878/1780] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:26:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:26:49.055402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f84fc9-57da-4d2e-ac37-c3ba54a82fea service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:49.091368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:49.100499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:49.100816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:49.104233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] PATH_INFO: `/v3/projects/19a1e95e7c464d769d1fc7dfa015c4cc` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:49.115943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a1e95e7c464d769d1fc7dfa015c4cc)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:49.126121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:49.440439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a1e95e7c464d769d1fc7dfa015c4cc', 'request_id': 'req-ee198758-18ab-4699-a039-c76d1244499e'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:49.475764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a1e95e7c464d769d1fc7dfa015c4cc', 'request_id': 'req-ee198758-18ab-4699-a039-c76d1244499e'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:49.503052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a1e95e7c464d769d1fc7dfa015c4cc', 'request_id': 'req-ee198758-18ab-4699-a039-c76d1244499e'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:49.804470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] The token cache is being invalidate because project 19a1e95e7c464d769d1fc7dfa015c4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:49.808560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:49.808560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:49.813657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 903/1781] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:49 2022] DELETE /identity/v3/projects/19a1e95e7c464d769d1fc7dfa015c4cc => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:49.817742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:49.835902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da2985-107e-42f6-8be1-3beb6773efe9 service swift] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:50.040636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:50.041384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:50.042191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:50.042536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] PATH_INFO: `/v3/users/ca36e0aae0894f1cb21527622ed0240b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:50.046618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca36e0aae0894f1cb21527622ed0240b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:50.055090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:50.601124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca36e0aae0894f1cb21527622ed0240b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:50.826641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca36e0aae0894f1cb21527622ed0240b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:50.826641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca36e0aae0894f1cb21527622ed0240b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:50.830807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca36e0aae0894f1cb21527622ed0240b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:50.839364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f787b9be-5d2a-4808-a3ec-f4f46cb8df45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca36e0aae0894f1cb21527622ed0240b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:50.850082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 879/1782] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:49 2022] DELETE /identity/v3/users/ca36e0aae0894f1cb21527622ed0240b => generated 0 bytes in 1030 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:51.507938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:51.967153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:51.970360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:52.149850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198758-18ab-4699-a039-c76d1244499e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:52.196365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:52.196888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:52.196987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:52.248068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:52.283173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] MFA Rules not processed for user `9a588483344147629a6f557a54c34c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:52.286133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:52.287128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:52.287620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:52.288068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:52.290219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:52.298396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:52.457428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 880/1783] 10.222.0.102 () {58 vars in 1016 bytes} [Fri Sep 2 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:52.537238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:52.539485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:52.546908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:52.550468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:52.553125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 904/1784] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:52.556791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:52.573710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbcfef-3226-48fe-a4ea-06b0c17e64c3 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:52.583256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:52.584281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:52.584418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:52.584692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:52.596089 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513b0fc-9d00-4b54-a7d6-945addc76d34 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:52.600363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:52.601938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:52.609973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:52.610679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:52.611006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:52.611293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:52.623629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 905/1785] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:52.626133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:52.627970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:52.640100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 881/1786] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:53.339668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:53.342358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:53.492753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b10d3-1687-425b-b02b-8ea315a80385 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:53.509978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:53.510929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:53.511361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:53.512221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] PATH_INFO: `/v3/users/3cebf0cc7e484c898ee4adcdd213e163` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:53.515550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cebf0cc7e484c898ee4adcdd213e163)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:53.520641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:53.530511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:53.530511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:53.564444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:53.588074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3037-fb99-49e2-a0d5-1b90b2fefeb5 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:53.617944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:53.617944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:53.617944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:53.617944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] PATH_INFO: `/v3/projects/d35e5d7fb89848bd84e1a28a17f31f1e` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:53.621367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35e5d7fb89848bd84e1a28a17f31f1e)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:53.626789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:53.923156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35e5d7fb89848bd84e1a28a17f31f1e', 'request_id': 'req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:53.929662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cebf0cc7e484c898ee4adcdd213e163'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:53.936267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cebf0cc7e484c898ee4adcdd213e163'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:53.967051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35e5d7fb89848bd84e1a28a17f31f1e', 'request_id': 'req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:54.127615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cebf0cc7e484c898ee4adcdd213e163'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:54.131028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cebf0cc7e484c898ee4adcdd213e163'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:54.151709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c16f0708-e8d7-474e-8f9c-6c80694ce058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cebf0cc7e484c898ee4adcdd213e163'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:54.194662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 906/1787] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:53 2022] DELETE /identity/v3/users/3cebf0cc7e484c898ee4adcdd213e163 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:54.199677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48c6f9-58fb-4614-be58-68c36eebe90c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:54.200383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48c6f9-58fb-4614-be58-68c36eebe90c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:54.200924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48c6f9-58fb-4614-be58-68c36eebe90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:54.241951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-3c48c6f9-58fb-4614-be58-68c36eebe90c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:54.243484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3c48c6f9-58fb-4614-be58-68c36eebe90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:54.278708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35e5d7fb89848bd84e1a28a17f31f1e', 'request_id': 'req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:54.308000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] The token cache is being invalidate because project d35e5d7fb89848bd84e1a28a17f31f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:54.308541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:54.310942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0ecead8b-8ea9-4959-ac32-6c775fbd6dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:54.321760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 882/1788] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:53 2022] DELETE /identity/v3/projects/d35e5d7fb89848bd84e1a28a17f31f1e => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:54.327760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:54.327760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:54.327760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:54.373685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:54.378613 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:54.384796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 907/1789] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:54.413152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 883/1790] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:54.421935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1cb09-7dc3-42f1-8817-ff92b2620b02 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:54.422478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1cb09-7dc3-42f1-8817-ff92b2620b02 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:54.422942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1cb09-7dc3-42f1-8817-ff92b2620b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:54.438042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:54.440072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:54.477995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-59e1cb09-7dc3-42f1-8817-ff92b2620b02 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:54.484694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-59e1cb09-7dc3-42f1-8817-ff92b2620b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:54.512111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 908/1791] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:54.517726 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1cb09-7dc3-42f1-8817-ff92b2620b02 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:54.539605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1cb09-7dc3-42f1-8817-ff92b2620b02 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:54.555302 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:54.556537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:54.557079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:54.557817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:54.558742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:54.560124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:54.562314 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:54.578522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 909/1792] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:54.585728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:54.602545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32301e14-d046-435f-9c01-f90a6737183a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:54.603831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f67b7-8280-4a3c-9b2f-078f06b96c22 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:54.614337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:54.615944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:54.616429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:54.616919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:54.619284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:54.620038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:54.620419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:54.620951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:54.622955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:54.625186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:54.630872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:54.632990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:54.650582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 884/1793] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:54.839273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 910/1794] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:54 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:26:54.842723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:54.866984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbadb39-26f4-4db8-99bd-a20142d2c3b9 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:55.075070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:55.075781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.076069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.077468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.081146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:55.084955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:55.257906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 885/1795] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:54 2022] POST /identity/v3/users => generated 288 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:26:55.263271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:55.279716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d1be-614c-4329-b6b5-42938ed97d76 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:55.299323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:55.300018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.300258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.300483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.301171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:55.302792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:55.324057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 911/1796] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:55.328025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:55.360583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a07af-d859-49de-aca4-0cabd436980b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:55.395226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:55.406837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.412105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.412105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.412105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:55.412105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:55.457698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 886/1797] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:55.461042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:55.476852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc63b98-1464-499b-b91f-2b5d49afae2a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:55.483610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3139ccd-8733-4bf6-be7b-e5201393199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:55.485116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139ccd-8733-4bf6-be7b-e5201393199e admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.485665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139ccd-8733-4bf6-be7b-e5201393199e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.486155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139ccd-8733-4bf6-be7b-e5201393199e admin admin] PATH_INFO: `/v3/projects/6034e483fab34b43b0439e1a8f576063/users/743bb61fb1b6417fb6e5378ead863e5b/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.518985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3139ccd-8733-4bf6-be7b-e5201393199e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6034e483fab34b43b0439e1a8f576063, user_id=743bb61fb1b6417fb6e5378ead863e5b, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:55.522214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3139ccd-8733-4bf6-be7b-e5201393199e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:55.598179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:55.600006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:55.733552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 912/1798] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:55 2022] PUT /identity/v3/projects/6034e483fab34b43b0439e1a8f576063/users/743bb61fb1b6417fb6e5378ead863e5b/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:55.740371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645efc-d23b-45e0-a006-2dd42352a6ba admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:55.756679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63dc9-2a99-44a7-9b48-42619ca6bd57 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.756679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63dc9-2a99-44a7-9b48-42619ca6bd57 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.756679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63dc9-2a99-44a7-9b48-42619ca6bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.827674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:55.832893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2aa63dc9-2a99-44a7-9b48-42619ca6bd57 None None] MFA Rules not processed for user `743bb61fb1b6417fb6e5378ead863e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:55.834318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2aa63dc9-2a99-44a7-9b48-42619ca6bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:55.884841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d2a16-f9c6-406c-9b94-9c295f999114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:55.885483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2a16-f9c6-406c-9b94-9c295f999114 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.885761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2a16-f9c6-406c-9b94-9c295f999114 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.886041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2a16-f9c6-406c-9b94-9c295f999114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.891582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0f1d2a16-f9c6-406c-9b94-9c295f999114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:56.016804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 913/1799] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:56.018497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63dc9-2a99-44a7-9b48-42619ca6bd57 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:56.045588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d2a16-f9c6-406c-9b94-9c295f999114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:56.046926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d2a16-f9c6-406c-9b94-9c295f999114 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:56.084505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 887/1800] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:56.132252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63dc9-2a99-44a7-9b48-42619ca6bd57 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:56.138833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:56.139502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.139808 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.140064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.140709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:56.143666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:56.157029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1687697-ade9-43bd-bee9-dd5c1694cf2e None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.157029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1687697-ade9-43bd-bee9-dd5c1694cf2e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.157029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1687697-ade9-43bd-bee9-dd5c1694cf2e None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.157029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 888/1801] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:26:56.170967 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.171256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.171550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.220331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:56.221706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:56.268219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 914/1802] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:56 2022] POST /identity/v3/projects => generated 375 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:56.269917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:56.409121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 889/1803] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:56.455101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd947-99c5-47f4-8569-511d27256a14 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:56.484914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:56.486219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.486658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.487254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.488603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:56.490848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:56.534785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:56.536232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:56.557093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d07b15-c8ea-412b-ae9d-5fd13e851533 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:56.649192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:56.649739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.650090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.650338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.668832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:56.677840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:56.718048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 890/1804] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:56.779691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:56.787488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 915/1805] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:56 2022] POST /identity/v3/users => generated 294 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:56.793133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:56.797613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:56.826602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb07869-282c-444a-8fa6-211b3617052a service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:56.844196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7281-b0e6-4ec8-a908-a6971d9b3a50 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:56.865061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:56.872358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:56.874871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.875698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.877312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.879046 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:56.882700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:56.883884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.884385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.884867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] PATH_INFO: `/v3/projects/68db6015431a4a599b23041186fc7548` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.913865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68db6015431a4a599b23041186fc7548)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:56.913865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:56.914163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 891/1806] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:56.914163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:56.944150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f966-96e3-48fa-890d-384f32814116 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:56.967847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:56.978172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.978622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.979065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] PATH_INFO: `/v3/projects/f9be94cd4c364ae2b04acc07800dbbeb/users/4e0a65c7bd7e4f598caaed9d1e967cf1/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.021592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9be94cd4c364ae2b04acc07800dbbeb, user_id=4e0a65c7bd7e4f598caaed9d1e967cf1, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:57.043572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:57.205138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 892/1807] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:56 2022] PUT /identity/v3/projects/f9be94cd4c364ae2b04acc07800dbbeb/users/4e0a65c7bd7e4f598caaed9d1e967cf1/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:26:57.209698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:57.229202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68db6015431a4a599b23041186fc7548', 'request_id': 'req-4479d765-568f-4c75-9a0d-e4ba0313e719'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.259981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68db6015431a4a599b23041186fc7548', 'request_id': 'req-4479d765-568f-4c75-9a0d-e4ba0313e719'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.291963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68db6015431a4a599b23041186fc7548', 'request_id': 'req-4479d765-568f-4c75-9a0d-e4ba0313e719'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.408002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] The token cache is being invalidate because project 68db6015431a4a599b23041186fc7548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:57.408540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.409774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.413718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c1196-122e-4da0-a2dd-e368db1644a8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:57.417437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 916/1808] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:56 2022] DELETE /identity/v3/projects/68db6015431a4a599b23041186fc7548 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:26:57.419336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:57.421875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:57.422326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:57.423220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:57.423740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:57.424336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.425796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:57.428923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:57.488537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 893/1809] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:57.493970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:57.501075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:57.541125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd071d3d-7a30-47e9-a345-1120259df4cc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:57.552893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479d765-568f-4c75-9a0d-e4ba0313e719 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:57.557445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f2697-7ba2-4d1e-bad8-c89d9801fc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:57.558149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2697-7ba2-4d1e-bad8-c89d9801fc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:57.558466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:57.559784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:57.560897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2697-7ba2-4d1e-bad8-c89d9801fc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:57.561283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2697-7ba2-4d1e-bad8-c89d9801fc2e admin admin] PATH_INFO: `/v3/projects/f9be94cd4c364ae2b04acc07800dbbeb/users/4e0a65c7bd7e4f598caaed9d1e967cf1/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.566640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:57.567113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] PATH_INFO: `/v3/users/8fe42ae911d14bc78be3fa749abdbf4f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.568853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe42ae911d14bc78be3fa749abdbf4f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:57.580493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f2697-7ba2-4d1e-bad8-c89d9801fc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9be94cd4c364ae2b04acc07800dbbeb, user_id=4e0a65c7bd7e4f598caaed9d1e967cf1, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:57.580687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:57.580839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f2697-7ba2-4d1e-bad8-c89d9801fc2e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:57.600204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 894/1810] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:57 2022] PUT /identity/v3/projects/f9be94cd4c364ae2b04acc07800dbbeb/users/4e0a65c7bd7e4f598caaed9d1e967cf1/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:57.612376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:57.612661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:57.613153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.663850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] MFA Rules not processed for user `4e0a65c7bd7e4f598caaed9d1e967cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:57.665363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:57.809837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 895/1811] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:57.823562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:57.825628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:57.915875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe42ae911d14bc78be3fa749abdbf4f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.926169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe42ae911d14bc78be3fa749abdbf4f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.981771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056174b6-440b-4b24-a6a3-cae4afa082fb None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:57.985726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016fec7-6fec-4a9d-b2a1-a7365153d4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:57.986570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016fec7-6fec-4a9d-b2a1-a7365153d4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:57.986952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016fec7-6fec-4a9d-b2a1-a7365153d4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:57.987257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016fec7-6fec-4a9d-b2a1-a7365153d4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.989050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2016fec7-6fec-4a9d-b2a1-a7365153d4f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:58.021200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe42ae911d14bc78be3fa749abdbf4f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:58.021905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe42ae911d14bc78be3fa749abdbf4f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:58.046208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe42ae911d14bc78be3fa749abdbf4f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:58.093156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:58.099146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 917/1812] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:57 2022] DELETE /identity/v3/users/8fe42ae911d14bc78be3fa749abdbf4f => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:58.145503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016fec7-6fec-4a9d-b2a1-a7365153d4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:58.147146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016fec7-6fec-4a9d-b2a1-a7365153d4f9 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:58.171339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 896/1813] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:58.470218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:58.802877 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:58.804650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:58.927037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edef1e8-a7be-4f14-ab28-f59f3a24c9c4 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:58.933337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:58.934312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:58.935007 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:58.935466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] PATH_INFO: `/v3/projects/4f23f3bc1ffb4cceb31eef75b90c7d41` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:58.937245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f23f3bc1ffb4cceb31eef75b90c7d41)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:58.939968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:59.168092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f23f3bc1ffb4cceb31eef75b90c7d41', 'request_id': 'req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.173207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f23f3bc1ffb4cceb31eef75b90c7d41', 'request_id': 'req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.180994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f23f3bc1ffb4cceb31eef75b90c7d41', 'request_id': 'req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.358866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] The token cache is being invalidate because project 4f23f3bc1ffb4cceb31eef75b90c7d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:59.359238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.360124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a2f18ba5-d7d8-441c-92f9-ff62c5b4e15b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.366442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 918/1814] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:58 2022] DELETE /identity/v3/projects/4f23f3bc1ffb4cceb31eef75b90c7d41 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:59.369357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320912-1373-4843-97fe-ff1be88f5fbd None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.369887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320912-1373-4843-97fe-ff1be88f5fbd None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.370454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320912-1373-4843-97fe-ff1be88f5fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.403805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bc320912-1373-4843-97fe-ff1be88f5fbd None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:59.405243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bc320912-1373-4843-97fe-ff1be88f5fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:59.531368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 897/1815] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:59.542369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56583-5626-4eb4-843a-63354e0d8831 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.543024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56583-5626-4eb4-843a-63354e0d8831 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.543434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56583-5626-4eb4-843a-63354e0d8831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.582322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-3de56583-5626-4eb4-843a-63354e0d8831 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:59.583613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3de56583-5626-4eb4-843a-63354e0d8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:59.600757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 919/1816] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:59.607451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320912-1373-4843-97fe-ff1be88f5fbd None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:59.625320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320912-1373-4843-97fe-ff1be88f5fbd None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:59.631508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:59.632289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.632445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.632903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.633388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:59.633689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:59.635683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:59.668351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 898/1817] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:59.669672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56583-5626-4eb4-843a-63354e0d8831 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:59.685000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56583-5626-4eb4-843a-63354e0d8831 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:59.692295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:59.692295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.692295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.692295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.696197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:59.698204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:59.848757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 920/1818] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:59 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:59.851591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:59.863952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd4aac-734d-43f8-9f5d-2a7db454e29b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:59.936463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:59.937227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.937582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.937957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.938936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:59.940706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.065670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 899/1819] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:59 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:00.070177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.081848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6c61b-0a74-4844-8022-e816092c0251 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.087035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208124e-9502-4805-9905-b0358181916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.087666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208124e-9502-4805-9905-b0358181916b admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.087952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208124e-9502-4805-9905-b0358181916b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.088282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208124e-9502-4805-9905-b0358181916b admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.088934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208124e-9502-4805-9905-b0358181916b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.091130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208124e-9502-4805-9905-b0358181916b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.108826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 921/1820] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:00.109828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.120440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0223e74-6a97-41b5-837b-a2f93f16dc48 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.126252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4e4bf-669e-416c-9330-6637050a0b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.126860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e4bf-669e-416c-9330-6637050a0b5b admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.127145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e4bf-669e-416c-9330-6637050a0b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.127421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e4bf-669e-416c-9330-6637050a0b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.128100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4e4bf-669e-416c-9330-6637050a0b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.129738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4e4bf-669e-416c-9330-6637050a0b5b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.142028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 900/1821] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:00.148351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208124e-9502-4805-9905-b0358181916b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.159989 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208124e-9502-4805-9905-b0358181916b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.167072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.167859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.168261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.169055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] PATH_INFO: `/v3/projects/91bd4b2868f94828b14c72534f904d11/users/0ae942b6de4d4922a40141ebee57474b/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.188504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bd4b2868f94828b14c72534f904d11, user_id=0ae942b6de4d4922a40141ebee57474b, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.191449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.294325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 922/1822] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:00 2022] PUT /identity/v3/projects/91bd4b2868f94828b14c72534f904d11/users/0ae942b6de4d4922a40141ebee57474b/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:00.308789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89211a-6628-429e-b008-ca0b6b94656e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.309992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89211a-6628-429e-b008-ca0b6b94656e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.310545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89211a-6628-429e-b008-ca0b6b94656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.378031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6a89211a-6628-429e-b008-ca0b6b94656e None None] MFA Rules not processed for user `0ae942b6de4d4922a40141ebee57474b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:00.380140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6a89211a-6628-429e-b008-ca0b6b94656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:00.489147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 901/1823] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:00.502767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.505908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:00.596099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e148c7-f853-4d45-a7ec-21b747045e86 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.599764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f63a14-9ad7-44f0-b661-f0235ebe608f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.600370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63a14-9ad7-44f0-b661-f0235ebe608f service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.600678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63a14-9ad7-44f0-b661-f0235ebe608f service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.600982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63a14-9ad7-44f0-b661-f0235ebe608f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.610559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f63a14-9ad7-44f0-b661-f0235ebe608f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.612150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f63a14-9ad7-44f0-b661-f0235ebe608f service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.622453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 923/1824] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:00.649040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89211a-6628-429e-b008-ca0b6b94656e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.729617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89211a-6628-429e-b008-ca0b6b94656e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.736364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.737079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.737343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.737615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] PATH_INFO: `/v3/users/0ae942b6de4d4922a40141ebee57474b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.738880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae942b6de4d4922a40141ebee57474b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.740859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:01.622804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae942b6de4d4922a40141ebee57474b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:01.788601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae942b6de4d4922a40141ebee57474b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:01.789880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae942b6de4d4922a40141ebee57474b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:01.831844 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae942b6de4d4922a40141ebee57474b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:01.840185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae942b6de4d4922a40141ebee57474b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:01.850071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 902/1825] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:00 2022] DELETE /identity/v3/users/0ae942b6de4d4922a40141ebee57474b => generated 0 bytes in 1202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:01.854609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:01.856550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:01.856550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:01.877000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:01.878735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:01.947442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 924/1826] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:01.958213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:01.960151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:02.042254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61c497-c9ef-45f7-821b-f00b8dcac8a7 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:02.046441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0c6ce-8801-4bc2-aec7-af2bf842c363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:02.047076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0c6ce-8801-4bc2-aec7-af2bf842c363 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:02.047359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0c6ce-8801-4bc2-aec7-af2bf842c363 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:02.047635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0c6ce-8801-4bc2-aec7-af2bf842c363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:02.058478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0c6ce-8801-4bc2-aec7-af2bf842c363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:02.059968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0c6ce-8801-4bc2-aec7-af2bf842c363 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:02.071126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 903/1827] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:02.077687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:02.561216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:02.708103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:02.713697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:02.731914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76736-7d6d-4bc9-8ae1-836bb4a228e2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:02.737320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:02.737734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:02.738017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:02.738293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] PATH_INFO: `/v3/projects/91bd4b2868f94828b14c72534f904d11` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:02.740458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bd4b2868f94828b14c72534f904d11)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:02.742825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:02.885875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bd4b2868f94828b14c72534f904d11', 'request_id': 'req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:02.896251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bd4b2868f94828b14c72534f904d11', 'request_id': 'req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:02.907453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bd4b2868f94828b14c72534f904d11', 'request_id': 'req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:03.034056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] The token cache is being invalidate because project 91bd4b2868f94828b14c72534f904d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:03.034352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:03.035037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d2421033-77d7-44ee-ae9e-57aa0aacf4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:03.036660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 925/1828] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:02 2022] DELETE /identity/v3/projects/91bd4b2868f94828b14c72534f904d11 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:03.041900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9374f-68d2-42b1-88c2-25cdf6df1095 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.042554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9374f-68d2-42b1-88c2-25cdf6df1095 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.042554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9374f-68d2-42b1-88c2-25cdf6df1095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.066724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0ed9374f-68d2-42b1-88c2-25cdf6df1095 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:03.072996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0ed9374f-68d2-42b1-88c2-25cdf6df1095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:03.144954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 904/1829] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:03.153950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0e0b-5683-469e-903e-b70a694665e2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.154281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0e0b-5683-469e-903e-b70a694665e2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.154793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0e0b-5683-469e-903e-b70a694665e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.174918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-3f4e0e0b-5683-469e-903e-b70a694665e2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:03.183716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3f4e0e0b-5683-469e-903e-b70a694665e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:03.184255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 926/1830] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:03.189113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9374f-68d2-42b1-88c2-25cdf6df1095 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.199209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9374f-68d2-42b1-88c2-25cdf6df1095 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.205420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.206774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.207229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.208135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.209630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:03.210348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.216262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.231515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 905/1831] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:27:03.238176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0e0b-5683-469e-903e-b70a694665e2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.282034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0e0b-5683-469e-903e-b70a694665e2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.305117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.305741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.306021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.306375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.307300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.311151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.383376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.389622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:03.423690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb5f95-60dd-47bc-89e2-5c735bb8cb29 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.438406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.447854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.447854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.447854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] PATH_INFO: `/v3/users/6f1b3cab2ba24bf3a418128a9a3e8149` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.447854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1b3cab2ba24bf3a418128a9a3e8149)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.447854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.519317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 927/1832] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:03 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:03.520608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.527008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:03.603923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96436b1-2002-40b7-ab4e-bfee5d67b8ea admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.609690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.611394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.611788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.612243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.615369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:03.723181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.725733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.740792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 928/1833] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:03.741421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.805927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1b3cab2ba24bf3a418128a9a3e8149'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:03.849193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2f7b5-122d-43f2-a1e4-5029d5c05c81 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.854095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ea244-0b37-4920-a140-3ce706951c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.854779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea244-0b37-4920-a140-3ce706951c7f admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.855354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea244-0b37-4920-a140-3ce706951c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.855558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea244-0b37-4920-a140-3ce706951c7f admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.856868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ea244-0b37-4920-a140-3ce706951c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.859028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ea244-0b37-4920-a140-3ce706951c7f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.952516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1b3cab2ba24bf3a418128a9a3e8149'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:03.953727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1b3cab2ba24bf3a418128a9a3e8149'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:03.995318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1b3cab2ba24bf3a418128a9a3e8149'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:04.010050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-085f3f04-13fc-4dac-8e27-7a8bbccd0710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1b3cab2ba24bf3a418128a9a3e8149'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:04.015392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 906/1834] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:03 2022] DELETE /identity/v3/users/6f1b3cab2ba24bf3a418128a9a3e8149 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:04.016852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032bdb-52a1-418e-9f36-d586b48f3dab None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.017211 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032bdb-52a1-418e-9f36-d586b48f3dab None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.017557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032bdb-52a1-418e-9f36-d586b48f3dab None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.019028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 907/1835] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:27:04.020386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.022291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.022291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.052201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:04.058012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:04.058144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 929/1836] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:03 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:04.058144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1824a-4f18-4402-afa7-f584555075e7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.058144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1824a-4f18-4402-afa7-f584555075e7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.058144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1824a-4f18-4402-afa7-f584555075e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.079125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-11a1824a-4f18-4402-afa7-f584555075e7 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:04.080347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-11a1824a-4f18-4402-afa7-f584555075e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:04.128592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 908/1837] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:04.129714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:04.139503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:04.154921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625509-3407-4e36-a58d-07ed9518c447 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:04.176518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:04.177236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.177733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.178018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.179209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:04.181081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:04.201308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 909/1838] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:04.201308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:04.201308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:04.223151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 930/1839] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:04.225030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1824a-4f18-4402-afa7-f584555075e7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:04.257526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1824a-4f18-4402-afa7-f584555075e7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:04.269729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:04.270350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.275661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.275661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.275661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:04.275661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:04.326019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 931/1840] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:04.326445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:04.335374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:04.358090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616ac6-2759-4bfc-8842-c7977dedcfd6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:04.365166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999c5ea-a87e-4022-9200-7e44afc7c3c3 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:04.372373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:04.373235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.373642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.374020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.386408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7910d-2af3-46e4-857d-d68c1f5afbf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:04.386662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:04.387626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7910d-2af3-46e4-857d-d68c1f5afbf8 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.388704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7910d-2af3-46e4-857d-d68c1f5afbf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.389022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7910d-2af3-46e4-857d-d68c1f5afbf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.392661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:04.408615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 932/1841] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:04.409910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:04.423796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df6e5-efce-43f9-875b-40e94958f892 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:04.432400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7910d-2af3-46e4-857d-d68c1f5afbf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:04.435103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:04.436014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.436580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.437084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] PATH_INFO: `/v3/projects/9a936198a3e64b7b90eb65d0119b7483/users/7c5d75b5b06b4e76a175152e8d807748/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.453141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7910d-2af3-46e4-857d-d68c1f5afbf8 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:04.463565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a936198a3e64b7b90eb65d0119b7483, user_id=7c5d75b5b06b4e76a175152e8d807748, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:04.465018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:04.502991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 910/1842] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:04.589110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 933/1843] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:04 2022] PUT /identity/v3/projects/9a936198a3e64b7b90eb65d0119b7483/users/7c5d75b5b06b4e76a175152e8d807748/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:04.603249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:04.604045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:04.604585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:04.661508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] MFA Rules not processed for user `7c5d75b5b06b4e76a175152e8d807748`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:04.666131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:04.813064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 911/1844] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:04.824781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:04.835493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:05.111445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b79e8-ed1c-47bc-af0b-1c57688a2836 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:05.118691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:05.122197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:05.125132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:05.126278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:05.146643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:05.149626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:05.167638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 934/1845] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:06.028503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:06.030335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:06.207819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186d586-1be3-4802-bbc0-bbf69dd6f3f1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:06.217079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:06.218267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:06.218733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:06.219251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] PATH_INFO: `/v3/projects/fa5216fc30554cf599dbe62f4ab056d9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:06.221812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5216fc30554cf599dbe62f4ab056d9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:06.225454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:07.253008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5216fc30554cf599dbe62f4ab056d9', 'request_id': 'req-c995952f-e201-425a-9589-b92cfb0e2e68'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:07.259913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5216fc30554cf599dbe62f4ab056d9', 'request_id': 'req-c995952f-e201-425a-9589-b92cfb0e2e68'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:07.845605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:07.906084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5216fc30554cf599dbe62f4ab056d9', 'request_id': 'req-c995952f-e201-425a-9589-b92cfb0e2e68'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:07.925157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] The token cache is being invalidate because project fa5216fc30554cf599dbe62f4ab056d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:07.926884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:07.934367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:07.936364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 912/1846] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:06 2022] DELETE /identity/v3/projects/fa5216fc30554cf599dbe62f4ab056d9 => generated 0 bytes in 1909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:07.940348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:07.955848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6188-395d-44c8-9668-5853c9994dba service glance] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:08.040371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:08.041609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:08.041899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:08.042179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] PATH_INFO: `/v3/users/fceeae502696410e8c2bd652249fef21` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:08.043542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fceeae502696410e8c2bd652249fef21)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:08.046510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:08.337465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fceeae502696410e8c2bd652249fef21'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:08.337885 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fceeae502696410e8c2bd652249fef21'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:08.419121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fceeae502696410e8c2bd652249fef21'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:08.420198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fceeae502696410e8c2bd652249fef21'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:08.430939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fceeae502696410e8c2bd652249fef21'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:08.460344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 935/1847] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:07 2022] DELETE /identity/v3/users/fceeae502696410e8c2bd652249fef21 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:09.050767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:09.052273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:09.070889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995952f-e201-425a-9589-b92cfb0e2e68 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:09.174034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:09.174865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:09.175200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:09.175530 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] PATH_INFO: `/v3/projects/2d94884a6e864ad4aa019b73e9e61033` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:09.177346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d94884a6e864ad4aa019b73e9e61033)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:09.179356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:09.486375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d94884a6e864ad4aa019b73e9e61033', 'request_id': 'req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:09.508371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d94884a6e864ad4aa019b73e9e61033', 'request_id': 'req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:09.669408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d94884a6e864ad4aa019b73e9e61033', 'request_id': 'req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:09.688205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] The token cache is being invalidate because project 2d94884a6e864ad4aa019b73e9e61033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:09.688889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:09.689884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:09.691497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 913/1848] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:09 2022] DELETE /identity/v3/projects/2d94884a6e864ad4aa019b73e9e61033 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:09.695921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:09.697479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:09.712469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e7a6-5914-48e9-a105-c9ccd234b09a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:09.786923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:09.787765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:09.788125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:09.788484 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] PATH_INFO: `/v3/users/ac8fe709164c42609c30f3dd5e2b3c08` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:09.789814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8fe709164c42609c30f3dd5e2b3c08)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:09.792320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:10.069144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8fe709164c42609c30f3dd5e2b3c08'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:10.070146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8fe709164c42609c30f3dd5e2b3c08'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:10.191990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8fe709164c42609c30f3dd5e2b3c08'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:10.192659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8fe709164c42609c30f3dd5e2b3c08'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:10.204220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-344aba9b-013e-43ab-b5cf-04a9aabe36cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8fe709164c42609c30f3dd5e2b3c08'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:10.224692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 936/1849] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:09 2022] DELETE /identity/v3/users/ac8fe709164c42609c30f3dd5e2b3c08 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:10.465253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:10.827198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:10.834437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:10.845189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0625f1-cbfe-47a1-bc25-36c2966d1f48 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:10.938017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:10.938017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:10.938017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:10.938017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] PATH_INFO: `/v3/projects/bb511baa3d9644f0b60cd132978b7597` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:10.938901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb511baa3d9644f0b60cd132978b7597)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:10.938901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:11.119694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb511baa3d9644f0b60cd132978b7597', 'request_id': 'req-91538266-4c08-42d9-86db-5cc59a652541'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:11.130838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb511baa3d9644f0b60cd132978b7597', 'request_id': 'req-91538266-4c08-42d9-86db-5cc59a652541'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:11.220683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb511baa3d9644f0b60cd132978b7597', 'request_id': 'req-91538266-4c08-42d9-86db-5cc59a652541'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:11.235262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] The token cache is being invalidate because project bb511baa3d9644f0b60cd132978b7597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:11.235719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:11.236696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-91538266-4c08-42d9-86db-5cc59a652541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:11.238747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 914/1850] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:10 2022] DELETE /identity/v3/projects/bb511baa3d9644f0b60cd132978b7597 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:11.244657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170886f-9bd6-4e96-9ce1-2c9e0a03152d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.245935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170886f-9bd6-4e96-9ce1-2c9e0a03152d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.246430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170886f-9bd6-4e96-9ce1-2c9e0a03152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.287850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6170886f-9bd6-4e96-9ce1-2c9e0a03152d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:11.289110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6170886f-9bd6-4e96-9ce1-2c9e0a03152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:11.360022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 937/1851] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:11.370252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761a0f-5b68-4de5-9256-ff1354e24aea None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.370759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761a0f-5b68-4de5-9256-ff1354e24aea None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.371166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761a0f-5b68-4de5-9256-ff1354e24aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.396921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e4761a0f-5b68-4de5-9256-ff1354e24aea None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:11.398175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e4761a0f-5b68-4de5-9256-ff1354e24aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:11.408329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 915/1852] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:11.417082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170886f-9bd6-4e96-9ce1-2c9e0a03152d None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:11.436457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170886f-9bd6-4e96-9ce1-2c9e0a03152d None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:11.441326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:11.442028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.442308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.442584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.443250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:11.443553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:11.445228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:11.458243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 938/1853] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:27:11.464145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4761a0f-5b68-4de5-9256-ff1354e24aea None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:11.475097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4761a0f-5b68-4de5-9256-ff1354e24aea None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:11.479890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:11.481216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.481547 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.482055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.482794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:11.484880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:11.636491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 916/1854] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:11 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:11.642369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:11.653918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e705e4-2a66-4bdd-a614-959db84bb62b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:11.711718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:11.712271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.712591 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.712947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.713621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:11.715551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:11.827755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 939/1855] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:11 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:11.831992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:11.842823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf414f1-7854-4d39-99cc-09f0bdd2b4b6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:11.847525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:11.848125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.848402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.848672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.849352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:11.850930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:11.864424 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 917/1856] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:11.867197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:11.886879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f674ae-295f-46f3-8290-9113a62a149e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:11.891946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15646-e8d8-4e3a-8e81-c5505f91a782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:11.892604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15646-e8d8-4e3a-8e81-c5505f91a782 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.892942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15646-e8d8-4e3a-8e81-c5505f91a782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.893294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15646-e8d8-4e3a-8e81-c5505f91a782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.893943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15646-e8d8-4e3a-8e81-c5505f91a782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:11.895803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15646-e8d8-4e3a-8e81-c5505f91a782 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:11.911193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 940/1857] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:11.912491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:11.925599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c08e-9999-414f-afcc-9cbffc777553 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:11.930803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:11.931488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.931770 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.934710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] PATH_INFO: `/v3/projects/6d1397ba3eb4468aa6dc71da29b4d89a/users/6b2d0e4b960f43a9ab083088aaf479e4/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.949879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1397ba3eb4468aa6dc71da29b4d89a, user_id=6b2d0e4b960f43a9ab083088aaf479e4, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:11.952571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:12.049531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 918/1858] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:11 2022] PUT /identity/v3/projects/6d1397ba3eb4468aa6dc71da29b4d89a/users/6b2d0e4b960f43a9ab083088aaf479e4/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:12.060914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f296ac-d73d-4969-b731-25b8f37beccf None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:12.061595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f296ac-d73d-4969-b731-25b8f37beccf None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:12.061936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f296ac-d73d-4969-b731-25b8f37beccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:12.108174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-39f296ac-d73d-4969-b731-25b8f37beccf None None] MFA Rules not processed for user `6b2d0e4b960f43a9ab083088aaf479e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:12.109614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-39f296ac-d73d-4969-b731-25b8f37beccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:12.202829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 941/1859] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:12.220067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:12.222671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:12.304503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:12.334347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332adf-dfd2-460b-8f03-3d380afe1302 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:12.344958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faac4a-9401-4abd-87f3-58f2c931f65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:12.346807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faac4a-9401-4abd-87f3-58f2c931f65b service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:12.347472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faac4a-9401-4abd-87f3-58f2c931f65b service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:12.348123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faac4a-9401-4abd-87f3-58f2c931f65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:12.363607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faac4a-9401-4abd-87f3-58f2c931f65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:12.365113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faac4a-9401-4abd-87f3-58f2c931f65b service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:12.378460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 919/1860] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:13.320580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:13.976791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb14d-c3f5-41f4-aeed-b6cdc5ac02e1 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:13.977316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb14d-c3f5-41f4-aeed-b6cdc5ac02e1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:13.977413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb14d-c3f5-41f4-aeed-b6cdc5ac02e1 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:13.979177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 942/1861] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:27:14.008884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b8b22-f3eb-4fb2-91ac-7a313227f58d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:14.009532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b8b22-f3eb-4fb2-91ac-7a313227f58d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:14.010771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b8b22-f3eb-4fb2-91ac-7a313227f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:14.063850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-d03b8b22-f3eb-4fb2-91ac-7a313227f58d None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:14.065659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d03b8b22-f3eb-4fb2-91ac-7a313227f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:14.183144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 920/1862] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:14.458343 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb14d-c3f5-41f4-aeed-b6cdc5ac02e1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:14.460539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-60eeb14d-c3f5-41f4-aeed-b6cdc5ac02e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:14.489276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb14d-c3f5-41f4-aeed-b6cdc5ac02e1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:14.500543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09e656-bd2c-49f1-93ed-d4ca0ba6d727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:14.501467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09e656-bd2c-49f1-93ed-d4ca0ba6d727 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:14.501847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09e656-bd2c-49f1-93ed-d4ca0ba6d727 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:14.502223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09e656-bd2c-49f1-93ed-d4ca0ba6d727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:14.517468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09e656-bd2c-49f1-93ed-d4ca0ba6d727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:14.517896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09e656-bd2c-49f1-93ed-d4ca0ba6d727 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:14.536264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 943/1863] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:14.635084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:16.289461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:17.151735 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b8b22-f3eb-4fb2-91ac-7a313227f58d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:17.285441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b8b22-f3eb-4fb2-91ac-7a313227f58d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:17.295570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:17.296370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:17.296525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:17.296779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] PATH_INFO: `/v3/users/6b2d0e4b960f43a9ab083088aaf479e4` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:17.298315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2d0e4b960f43a9ab083088aaf479e4)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:17.300397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:17.651110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2d0e4b960f43a9ab083088aaf479e4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.703977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:17.782038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2d0e4b960f43a9ab083088aaf479e4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.783637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2d0e4b960f43a9ab083088aaf479e4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.798601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2d0e4b960f43a9ab083088aaf479e4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.809109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2d0e4b960f43a9ab083088aaf479e4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.819889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 921/1864] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:17 2022] DELETE /identity/v3/users/6b2d0e4b960f43a9ab083088aaf479e4 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:17.825840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:17.828146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:17.828757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:17.853905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:17.856063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:17.956903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 944/1865] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:17.967680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:17.969815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:18.066969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be839cda-8d9e-44f9-ac8f-8a07b49edaaa admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:18.070966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2345179-e089-4701-bd7f-6d1be1969e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:18.071698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2345179-e089-4701-bd7f-6d1be1969e7c service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:18.071973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2345179-e089-4701-bd7f-6d1be1969e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:18.072291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2345179-e089-4701-bd7f-6d1be1969e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:18.082869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2345179-e089-4701-bd7f-6d1be1969e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:18.084304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2345179-e089-4701-bd7f-6d1be1969e7c service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:18.095036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 922/1866] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:18.685233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:18.686960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:18.703948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227a1e6-82fb-4eee-886f-8f305923194f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:18.711832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:18.716505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:18.716505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:18.716505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] PATH_INFO: `/v3/projects/6d1397ba3eb4468aa6dc71da29b4d89a` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:18.717965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1397ba3eb4468aa6dc71da29b4d89a)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:18.721567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:18.957593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1397ba3eb4468aa6dc71da29b4d89a', 'request_id': 'req-8251d761-608e-4875-af27-725de4c77be0'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:18.966795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1397ba3eb4468aa6dc71da29b4d89a', 'request_id': 'req-8251d761-608e-4875-af27-725de4c77be0'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:18.976226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1397ba3eb4468aa6dc71da29b4d89a', 'request_id': 'req-8251d761-608e-4875-af27-725de4c77be0'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.142282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] The token cache is being invalidate because project 6d1397ba3eb4468aa6dc71da29b4d89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:19.142785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.143544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-8251d761-608e-4875-af27-725de4c77be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.145921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 945/1867] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:18 2022] DELETE /identity/v3/projects/6d1397ba3eb4468aa6dc71da29b4d89a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:19.152754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd54ca-2a04-40d6-a1e2-5386a8be71a3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:19.153609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd54ca-2a04-40d6-a1e2-5386a8be71a3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:19.153796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd54ca-2a04-40d6-a1e2-5386a8be71a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:19.179047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e7cd54ca-2a04-40d6-a1e2-5386a8be71a3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:19.180325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e7cd54ca-2a04-40d6-a1e2-5386a8be71a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:19.269970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 923/1868] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:19.279028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236db97-78e6-44a4-88e0-ffcdd52678e8 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:19.279332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236db97-78e6-44a4-88e0-ffcdd52678e8 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:19.279824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236db97-78e6-44a4-88e0-ffcdd52678e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:19.306614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1236db97-78e6-44a4-88e0-ffcdd52678e8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:19.308002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1236db97-78e6-44a4-88e0-ffcdd52678e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:19.326206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 946/1869] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:19.331546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd54ca-2a04-40d6-a1e2-5386a8be71a3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:19.345803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd54ca-2a04-40d6-a1e2-5386a8be71a3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:19.351557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:19.352213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:19.352500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:19.352810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:19.353488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:19.353851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:19.357067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:19.370838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 924/1870] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:27:19.376128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236db97-78e6-44a4-88e0-ffcdd52678e8 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:19.389514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236db97-78e6-44a4-88e0-ffcdd52678e8 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:19.396173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:19.396879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:19.397169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:19.397637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:19.398308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:19.402900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:19.568867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 947/1871] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:19 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:19.571314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:19.582310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ef2c-3912-4319-a8cb-ab3864c6d955 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:19.655290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:19.656309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:19.656756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:19.657052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:19.657690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:19.659881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:19.892198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 925/1872] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:19 2022] POST /identity/v3/users => generated 286 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:19.900914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:19.912771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdd3ba-843f-4a07-be86-c37b76733665 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:19.918693 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:19.919695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:19.920216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:19.920696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:19.921600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:19.923506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:19.924261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:19.935755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 948/1873] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:19.940334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:19.955044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9064c-fcbc-43b0-adef-60caa031b298 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:19.961785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1651e92-34dd-4c34-8239-b790df82020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:19.963119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651e92-34dd-4c34-8239-b790df82020a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:19.963634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651e92-34dd-4c34-8239-b790df82020a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:19.964123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651e92-34dd-4c34-8239-b790df82020a admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:19.966145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651e92-34dd-4c34-8239-b790df82020a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:19.968033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651e92-34dd-4c34-8239-b790df82020a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:19.981658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 926/1874] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:19.987913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:19.999049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad5458-5122-4c1c-90c6-c17aea7df3e6 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:20.004427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:20.005347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:20.005641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:20.005917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] PATH_INFO: `/v3/projects/bb010a14988747bbaa6e7d8b9cad069b/users/bb2ddf02647947d099857eac9a2f39ac/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:20.025127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb010a14988747bbaa6e7d8b9cad069b, user_id=bb2ddf02647947d099857eac9a2f39ac, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:20.028444 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:20.199752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 949/1875] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:19 2022] PUT /identity/v3/projects/bb010a14988747bbaa6e7d8b9cad069b/users/bb2ddf02647947d099857eac9a2f39ac/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:20.211294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:20.211818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:20.211960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:20.254476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] MFA Rules not processed for user `bb2ddf02647947d099857eac9a2f39ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:20.256112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:20.368672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 927/1876] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:20.379320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:20.383111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:20.388593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:20.467640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e7da-1023-4290-b03b-c71f28f9fa9c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:20.477303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a28f0-eebf-4713-9421-2877425fa097 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:20.478044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a28f0-eebf-4713-9421-2877425fa097 service glance] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:20.479415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a28f0-eebf-4713-9421-2877425fa097 service glance] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:20.479702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a28f0-eebf-4713-9421-2877425fa097 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:20.503676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a28f0-eebf-4713-9421-2877425fa097 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:20.506131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a28f0-eebf-4713-9421-2877425fa097 service glance] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:20.535710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 950/1877] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:22.575066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:23.895947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:24.312291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:24.313808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:24.405322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e531a-8136-4b65-bb7b-6614c7fcaa24 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:24.412454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:24.413753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:24.414229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:24.414544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] PATH_INFO: `/v3/users/743bb61fb1b6417fb6e5378ead863e5b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:24.415994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=743bb61fb1b6417fb6e5378ead863e5b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:24.418710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:24.798977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743bb61fb1b6417fb6e5378ead863e5b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:24.910562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743bb61fb1b6417fb6e5378ead863e5b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:24.910562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743bb61fb1b6417fb6e5378ead863e5b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:24.927981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743bb61fb1b6417fb6e5378ead863e5b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:24.945260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743bb61fb1b6417fb6e5378ead863e5b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:24.956704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 928/1878] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:24 2022] DELETE /identity/v3/users/743bb61fb1b6417fb6e5378ead863e5b => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:24.961278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:24.962091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:24.962226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:24.984561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:24.986021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:25.000043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:25.080703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 951/1879] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:25.090010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:25.091839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:25.172791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d377-6e9a-458b-98f7-f53ebfed4f9f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:25.177169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:25.177622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:25.181395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:25.181395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:25.192385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:25.194220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:25.208878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 929/1880] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:26.068926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:26.070388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:26.083189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b92cb-05dc-4f3d-b188-e07c55ed2b23 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:26.102294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:26.104321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:26.105562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:26.106090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] PATH_INFO: `/v3/projects/6034e483fab34b43b0439e1a8f576063` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:26.109105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6034e483fab34b43b0439e1a8f576063)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:26.111810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:26.337907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6034e483fab34b43b0439e1a8f576063', 'request_id': 'req-7f246263-5aca-4040-bdb7-efb23dbd0dd3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:26.343997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6034e483fab34b43b0439e1a8f576063', 'request_id': 'req-7f246263-5aca-4040-bdb7-efb23dbd0dd3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:26.353820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6034e483fab34b43b0439e1a8f576063', 'request_id': 'req-7f246263-5aca-4040-bdb7-efb23dbd0dd3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:26.512611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] The token cache is being invalidate because project 6034e483fab34b43b0439e1a8f576063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:26.512956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:26.513649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:26.515174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 952/1881] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:26 2022] DELETE /identity/v3/projects/6034e483fab34b43b0439e1a8f576063 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:26.519142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:26.530396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8af0-5699-4801-b604-7bf974cc9d4f service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:26.596560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:26.597416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:26.597559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:26.597837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] PATH_INFO: `/v3/users/4e0a65c7bd7e4f598caaed9d1e967cf1` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:26.599054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0a65c7bd7e4f598caaed9d1e967cf1)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:26.601225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:26.926960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0a65c7bd7e4f598caaed9d1e967cf1'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:27.020580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0a65c7bd7e4f598caaed9d1e967cf1'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:27.021448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0a65c7bd7e4f598caaed9d1e967cf1'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:27.037874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0a65c7bd7e4f598caaed9d1e967cf1'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:27.049552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-89c417bb-7da2-49f5-b178-15e9595017ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0a65c7bd7e4f598caaed9d1e967cf1'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:27.059282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 930/1882] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:26 2022] DELETE /identity/v3/users/4e0a65c7bd7e4f598caaed9d1e967cf1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:27.798915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:27.806282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:27.807907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:27.822260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f246263-5aca-4040-bdb7-efb23dbd0dd3 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:27.894032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:27.895091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:27.895374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:27.895822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] PATH_INFO: `/v3/projects/f9be94cd4c364ae2b04acc07800dbbeb` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:27.897242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9be94cd4c364ae2b04acc07800dbbeb)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:27.899696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:27.971813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:28.089957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9be94cd4c364ae2b04acc07800dbbeb', 'request_id': 'req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:28.100095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9be94cd4c364ae2b04acc07800dbbeb', 'request_id': 'req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:28.108818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9be94cd4c364ae2b04acc07800dbbeb', 'request_id': 'req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:28.212322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] The token cache is being invalidate because project f9be94cd4c364ae2b04acc07800dbbeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:28.212637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:28.213415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b90033e2-dae2-43a2-8fcd-8dfea9b67ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:28.215221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 953/1883] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:27 2022] DELETE /identity/v3/projects/f9be94cd4c364ae2b04acc07800dbbeb => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:28.220343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2f46a-0903-4276-835d-6f10ab6a9ab1 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.220625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2f46a-0903-4276-835d-6f10ab6a9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.220919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2f46a-0903-4276-835d-6f10ab6a9ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:28.246149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-85a2f46a-0903-4276-835d-6f10ab6a9ab1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:28.247482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-85a2f46a-0903-4276-835d-6f10ab6a9ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:28.328295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 931/1884] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:28.336201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01e7e7-a15e-4642-96dc-0200620c90de None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.336482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01e7e7-a15e-4642-96dc-0200620c90de None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.336966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01e7e7-a15e-4642-96dc-0200620c90de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:28.360242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-5d01e7e7-a15e-4642-96dc-0200620c90de None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:28.361541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5d01e7e7-a15e-4642-96dc-0200620c90de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:28.369827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 954/1885] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:28.374934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2f46a-0903-4276-835d-6f10ab6a9ab1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:28.385302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2f46a-0903-4276-835d-6f10ab6a9ab1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:28.390795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:28.391417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.396512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.396512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:28.396512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:28.396512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:28.396512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:28.409618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 932/1886] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:27:28.414005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01e7e7-a15e-4642-96dc-0200620c90de None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:28.424790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01e7e7-a15e-4642-96dc-0200620c90de None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:28.431632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:28.432388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.432755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.433911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:28.434566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:28.436493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:28.631462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 955/1887] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:28 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:28.635803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:28.647738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0463c3-de90-4f6b-8bec-52777e551197 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:28.722675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:28.722675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.722675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.722675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:28.723076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:28.723076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:28.833736 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 933/1888] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:28 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:28.835290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:28.847793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c019747-cfc7-48ef-9df6-c77d0ee3986f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:28.864385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:28.865527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.865910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.866482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:28.867646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:28.870392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:28.886984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 956/1889] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:28.897728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:28.941945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9f9a6-3946-4f15-b2eb-b6eafa9b4f90 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:28.950312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133faf56-183c-4204-bdda-3a78e2fef870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:28.951133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133faf56-183c-4204-bdda-3a78e2fef870 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.951517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133faf56-183c-4204-bdda-3a78e2fef870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.952018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133faf56-183c-4204-bdda-3a78e2fef870 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:28.953272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133faf56-183c-4204-bdda-3a78e2fef870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:28.955283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133faf56-183c-4204-bdda-3a78e2fef870 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:28.970885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 934/1890] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:28.975471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:28.989297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6b3e-c364-40e9-87b8-e61e92a27b6b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:28.996717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:28.997629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:28.997974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:28.998254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] PATH_INFO: `/v3/projects/b9cc8e84db124ed0b290a71dc6ae6df8/users/76ffbc4dc9d4404086a17f21b8e8ff8b/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:29.027666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cc8e84db124ed0b290a71dc6ae6df8, user_id=76ffbc4dc9d4404086a17f21b8e8ff8b, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:29.030772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:29.223171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 957/1891] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:28 2022] PUT /identity/v3/projects/b9cc8e84db124ed0b290a71dc6ae6df8/users/76ffbc4dc9d4404086a17f21b8e8ff8b/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:29.246398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519043b-f194-4fcb-a5fb-af87a1276918 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:29.246398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519043b-f194-4fcb-a5fb-af87a1276918 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:29.246398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519043b-f194-4fcb-a5fb-af87a1276918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:29.291587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4519043b-f194-4fcb-a5fb-af87a1276918 None None] MFA Rules not processed for user `76ffbc4dc9d4404086a17f21b8e8ff8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:29.293509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4519043b-f194-4fcb-a5fb-af87a1276918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:29.395601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 935/1892] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:29.397311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:29.493496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d8ded-7ed6-4c90-8454-7017418e798b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:29.499696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:29.500586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:29.500909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:29.501183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:29.501842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:29.503988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:29.653915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 958/1893] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:29 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:29.657866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519043b-f194-4fcb-a5fb-af87a1276918 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:29.670939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519043b-f194-4fcb-a5fb-af87a1276918 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:29.764987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:29.765623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:29.765900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:29.766174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:29.766817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:29.774249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:29.912789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 936/1894] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:29 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:29.917093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:29.930067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e0a3a-ecbc-41ce-a13b-540d62445808 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:29.935480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:29.936201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:29.936675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:29.937060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:29.937836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:29.939799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:29.947267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:29.953704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 959/1895] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:29.961441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:29.972482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd086f6c-bdd2-49e5-98cf-0c37d951540a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:29.977870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:29.978539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:29.978813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:29.979087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] PATH_INFO: `/v3/projects/196133d30e5744fd88f299ebf3d07024/users/483e48b5b8e445198dcf92c98cf19e17/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:29.998681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196133d30e5744fd88f299ebf3d07024, user_id=483e48b5b8e445198dcf92c98cf19e17, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:30.003264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:30.189493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 937/1896] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:29 2022] PUT /identity/v3/projects/196133d30e5744fd88f299ebf3d07024/users/483e48b5b8e445198dcf92c98cf19e17/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:30.193701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:30.204862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb2b8a-8d1d-4942-8a02-c0015f6c608d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:30.273787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a72b5-1221-437c-b775-25ea52b6a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:30.274410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a72b5-1221-437c-b775-25ea52b6a8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:30.274691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a72b5-1221-437c-b775-25ea52b6a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:30.274973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a72b5-1221-437c-b775-25ea52b6a8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:30.275616 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a72b5-1221-437c-b775-25ea52b6a8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:30.278001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a72b5-1221-437c-b775-25ea52b6a8d9 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:30.299981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 960/1897] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:30.306489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:30.325559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0317466-d4d8-4e80-9214-c3d5b05c92d5 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:30.333289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:30.333727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:30.334007 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:30.334336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] PATH_INFO: `/v3/projects/196133d30e5744fd88f299ebf3d07024/users/483e48b5b8e445198dcf92c98cf19e17/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:30.336539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=196133d30e5744fd88f299ebf3d07024, user_id=483e48b5b8e445198dcf92c98cf19e17, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:30.340758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:30.371639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 938/1898] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:30 2022] PUT /identity/v3/projects/196133d30e5744fd88f299ebf3d07024/users/483e48b5b8e445198dcf92c98cf19e17/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:30.371837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052311-9297-4cb3-91bd-dbbc4e6892a4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:30.371837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052311-9297-4cb3-91bd-dbbc4e6892a4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:30.371837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052311-9297-4cb3-91bd-dbbc4e6892a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:30.397316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f4052311-9297-4cb3-91bd-dbbc4e6892a4 None None] MFA Rules not processed for user `483e48b5b8e445198dcf92c98cf19e17`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:30.398567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f4052311-9297-4cb3-91bd-dbbc4e6892a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:30.490621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 961/1899] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:30.504262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:30.506139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:30.589739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43308f-a1e9-43b7-b3ed-7e3b4a72e37a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:30.593869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:30.594492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:30.594773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:30.595051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:30.612453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:30.612688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:30.624988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 939/1900] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:27:31.272322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:32.204304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4052311-9297-4cb3-91bd-dbbc4e6892a4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:32.214878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4052311-9297-4cb3-91bd-dbbc4e6892a4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:32.221646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483e48b5b8e445198dcf92c98cf19e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '196133d30e5744fd88f299ebf3d07024', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:32.222848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:32.223308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:32.223767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:32.225440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:32.225440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:32.228184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:32.241583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 962/1901] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:27:32.248206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:32.258209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e0dec-8a50-44e8-8d1b-58c9047624f6 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:32.265451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483e48b5b8e445198dcf92c98cf19e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '196133d30e5744fd88f299ebf3d07024', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:32.266428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:32.266737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:32.266986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:32.267672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:32.270024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:32.354823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 940/1902] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:32 2022] POST /identity/v3/projects => generated 354 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:32.359971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:32.371729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7620-2b18-4591-afa7-d8bf4cde15f1 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:32.432326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483e48b5b8e445198dcf92c98cf19e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '196133d30e5744fd88f299ebf3d07024', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:32.433526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:32.433889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:32.434174 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:32.434840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:32.435152 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:32.436891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:32.451731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 963/1903] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:27:32.490337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:32.503462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02a2f6-08d1-464a-b735-abb94cec263e tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:32.510563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483e48b5b8e445198dcf92c98cf19e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '196133d30e5744fd88f299ebf3d07024', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:32.512050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:32.512578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:32.513110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] PATH_INFO: `/v3/projects/061bb94027b9442baa2c27ee4f8debd7` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:32.517684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorizing `identity:delete_project(project_id=061bb94027b9442baa2c27ee4f8debd7)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:32.518217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:32.673248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061bb94027b9442baa2c27ee4f8debd7', 'request_id': 'req-9047d267-aaa1-4fb3-a52c-5ff377fd4147'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:32.680410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061bb94027b9442baa2c27ee4f8debd7', 'request_id': 'req-9047d267-aaa1-4fb3-a52c-5ff377fd4147'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:32.781250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061bb94027b9442baa2c27ee4f8debd7', 'request_id': 'req-9047d267-aaa1-4fb3-a52c-5ff377fd4147'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:32.794537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] The token cache is being invalidate because project 061bb94027b9442baa2c27ee4f8debd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:32.794836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:32.795528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9047d267-aaa1-4fb3-a52c-5ff377fd4147 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:32.797189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 941/1904] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:32 2022] DELETE /identity/v3/projects/061bb94027b9442baa2c27ee4f8debd7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:33.377869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:33.947083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:33.949890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:34.022946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bde5e5-7bb3-4dfb-b19c-f01efa570ea4 tempest-VolumeQuotaClassesTest-120557974 tempest-VolumeQuotaClassesTest-120557974-project-admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:34.085238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:34.085887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:34.086172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:34.086448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] PATH_INFO: `/v3/users/76ffbc4dc9d4404086a17f21b8e8ff8b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:34.087608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ffbc4dc9d4404086a17f21b8e8ff8b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:34.089622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:34.556098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ffbc4dc9d4404086a17f21b8e8ff8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:34.556481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ffbc4dc9d4404086a17f21b8e8ff8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:34.577929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:34.782317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ffbc4dc9d4404086a17f21b8e8ff8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:34.783159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ffbc4dc9d4404086a17f21b8e8ff8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:34.804926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ffbc4dc9d4404086a17f21b8e8ff8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:34.828704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 964/1905] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:33 2022] DELETE /identity/v3/users/76ffbc4dc9d4404086a17f21b8e8ff8b => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:34.833994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:34.834867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:34.835237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:34.860937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:34.863025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:34.866649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:34.868209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:34.936325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 942/1906] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:34.947606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:34.949655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:34.951132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610431-4618-4a1a-b8ec-2e13f5262fcb admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:34.959048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:34.960060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:34.960495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:34.960965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] PATH_INFO: `/v3/users/7c5d75b5b06b4e76a175152e8d807748` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:34.962345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5d75b5b06b4e76a175152e8d807748)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:34.964471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:35.024957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559378c-30f8-46b5-9d59-f2c8df2e98b2 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:35.037605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:35.037605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:35.037605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:35.037605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:35.045490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:35.047024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:35.059307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 943/1907] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:27:35.601598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5d75b5b06b4e76a175152e8d807748'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:35.602655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5d75b5b06b4e76a175152e8d807748'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:35.695276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:35.698281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:35.712173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62986618-2382-4f5a-938c-087f227e7b2a service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:35.719731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:35.719949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:35.720194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:35.720453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] PATH_INFO: `/v3/projects/b9cc8e84db124ed0b290a71dc6ae6df8` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:35.733700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cc8e84db124ed0b290a71dc6ae6df8)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:35.739108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:35.773289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5d75b5b06b4e76a175152e8d807748'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:35.773289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5d75b5b06b4e76a175152e8d807748'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:35.804225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-af21bd07-a264-4bfe-9346-da2122031a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5d75b5b06b4e76a175152e8d807748'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:35.832855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 965/1908] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:34 2022] DELETE /identity/v3/users/7c5d75b5b06b4e76a175152e8d807748 => generated 0 bytes in 967 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:35.838096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:35.838483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:35.839057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:35.882836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:35.886544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:36.010600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cc8e84db124ed0b290a71dc6ae6df8', 'request_id': 'req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.031971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cc8e84db124ed0b290a71dc6ae6df8', 'request_id': 'req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.047147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 966/1909] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:36.074504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:36.076663 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:36.143682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97903f73-424c-44f6-804a-042e72f544a6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:36.183053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cc8e84db124ed0b290a71dc6ae6df8', 'request_id': 'req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.195563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] The token cache is being invalidate because project b9cc8e84db124ed0b290a71dc6ae6df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:36.196014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.196693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.198509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 944/1910] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:35 2022] DELETE /identity/v3/projects/b9cc8e84db124ed0b290a71dc6ae6df8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:36.202889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:36.204417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:36.205384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:36.206030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:36.206315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:36.206741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:36.208510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:36.284438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:36.286246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:36.308475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d423c4b-0a0f-44f5-ab53-24a8a2fd7ccd admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:36.312702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 967/1911] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:36.314395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:36.314654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:36.315098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:36.315532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] PATH_INFO: `/v3/users/483e48b5b8e445198dcf92c98cf19e17` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:36.316920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483e48b5b8e445198dcf92c98cf19e17)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:36.318992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:36.673916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483e48b5b8e445198dcf92c98cf19e17'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.808636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483e48b5b8e445198dcf92c98cf19e17'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.811855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483e48b5b8e445198dcf92c98cf19e17'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.830472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483e48b5b8e445198dcf92c98cf19e17'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.844976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5c46b3c9-b70d-4166-85ea-209c6b98d1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483e48b5b8e445198dcf92c98cf19e17'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:36.861987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 945/1912] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:36 2022] DELETE /identity/v3/users/483e48b5b8e445198dcf92c98cf19e17 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:37.143244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:37.145583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:37.149014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:37.173461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca422d6-75f5-47b9-b5ed-8e0c4b9cc441 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:37.353464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:37.354249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:37.355904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:37.356576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] PATH_INFO: `/v3/projects/9a936198a3e64b7b90eb65d0119b7483` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:37.358306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a936198a3e64b7b90eb65d0119b7483)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:37.361376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:37.589453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a936198a3e64b7b90eb65d0119b7483', 'request_id': 'req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:37.596334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a936198a3e64b7b90eb65d0119b7483', 'request_id': 'req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:37.603312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a936198a3e64b7b90eb65d0119b7483', 'request_id': 'req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:37.753766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] The token cache is being invalidate because project 9a936198a3e64b7b90eb65d0119b7483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:37.760185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:37.760185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-99b9020d-f8b0-46cc-b511-c46d1fcfefb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:37.760185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 968/1913] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:37 2022] DELETE /identity/v3/projects/9a936198a3e64b7b90eb65d0119b7483 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:37.764503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d96a5-69d1-4fb9-b7e9-45ce8e8b4486 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:37.765287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d96a5-69d1-4fb9-b7e9-45ce8e8b4486 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:37.766133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d96a5-69d1-4fb9-b7e9-45ce8e8b4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:37.791163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c31d96a5-69d1-4fb9-b7e9-45ce8e8b4486 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:37.793884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c31d96a5-69d1-4fb9-b7e9-45ce8e8b4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:37.875149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 946/1914] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:37.879298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401909-0ea1-4018-a6de-b1dbed2f4033 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:37.879594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401909-0ea1-4018-a6de-b1dbed2f4033 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:37.879923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401909-0ea1-4018-a6de-b1dbed2f4033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:37.904086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6a401909-0ea1-4018-a6de-b1dbed2f4033 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:37.909244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6a401909-0ea1-4018-a6de-b1dbed2f4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:37.921010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 969/1915] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:37.925840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d96a5-69d1-4fb9-b7e9-45ce8e8b4486 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:37.937277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d96a5-69d1-4fb9-b7e9-45ce8e8b4486 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:37.942868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ad221-345a-448d-b635-d358997d555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:37.946867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ad221-345a-448d-b635-d358997d555b admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:37.946867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ad221-345a-448d-b635-d358997d555b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:37.946867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ad221-345a-448d-b635-d358997d555b admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:37.946867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ad221-345a-448d-b635-d358997d555b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:37.946867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ad221-345a-448d-b635-d358997d555b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:37.947206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ad221-345a-448d-b635-d358997d555b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:37.963629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 947/1916] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:27:37.969651 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401909-0ea1-4018-a6de-b1dbed2f4033 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:37.980346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401909-0ea1-4018-a6de-b1dbed2f4033 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:37.986440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:37.987050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:37.987328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:37.987595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:37.988239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:37.990244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.111976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ad221-345a-448d-b635-d358997d555b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.114100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-910ad221-345a-448d-b635-d358997d555b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:38.131308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ad221-345a-448d-b635-d358997d555b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.136472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.137517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.137891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.148803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] PATH_INFO: `/v3/projects/196133d30e5744fd88f299ebf3d07024` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.148803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196133d30e5744fd88f299ebf3d07024)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.148803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.187245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 970/1917] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:37 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:38.191133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.266778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49efc-5c6b-4fbe-ae1c-12bf5f477834 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.271788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.272453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.272754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.273037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.273694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.275916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.317273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196133d30e5744fd88f299ebf3d07024', 'request_id': 'req-5db27c01-0a61-4bac-a7e7-4e08ef16e534'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:38.325797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196133d30e5744fd88f299ebf3d07024', 'request_id': 'req-5db27c01-0a61-4bac-a7e7-4e08ef16e534'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:38.435100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 971/1918] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:38 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:38.439820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.450535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1429f-4706-47fa-8d3e-1ea287decf6d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.474618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196133d30e5744fd88f299ebf3d07024', 'request_id': 'req-5db27c01-0a61-4bac-a7e7-4e08ef16e534'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:38.477715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:38.490830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] The token cache is being invalidate because project 196133d30e5744fd88f299ebf3d07024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:38.491179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:38.491838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5db27c01-0a61-4bac-a7e7-4e08ef16e534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:38.494606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 948/1919] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:38 2022] DELETE /identity/v3/projects/196133d30e5744fd88f299ebf3d07024 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:38.504463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369878-1d9d-4915-a538-dc7c59d2982e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.516643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369878-1d9d-4915-a538-dc7c59d2982e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.517042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369878-1d9d-4915-a538-dc7c59d2982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.526976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.527694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.528069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.528352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.529287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.531115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.549208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 972/1920] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:38.553244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.555006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:38.566467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:38.569084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-62369878-1d9d-4915-a538-dc7c59d2982e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:38.569084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-62369878-1d9d-4915-a538-dc7c59d2982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:38.588304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6520b-a412-4e35-be57-2e55ae790cce admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.591156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 949/1921] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:38.599659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615acb78-e035-4b8f-9c1e-eca95e657c36 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.600171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615acb78-e035-4b8f-9c1e-eca95e657c36 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.600542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615acb78-e035-4b8f-9c1e-eca95e657c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.601178 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.601800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.602082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.602359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.603010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.605394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.620074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 973/1922] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:27:38.623041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.627857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-615acb78-e035-4b8f-9c1e-eca95e657c36 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:38.629232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-615acb78-e035-4b8f-9c1e-eca95e657c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:38.634123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de036-ffea-4029-b6d2-7bd24a2c613c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.639309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 950/1923] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:38.647008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a16dc2-08d6-4ce4-9516-63c993dd2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.647710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16dc2-08d6-4ce4-9516-63c993dd2efc admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.648114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615acb78-e035-4b8f-9c1e-eca95e657c36 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.648904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16dc2-08d6-4ce4-9516-63c993dd2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.650890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16dc2-08d6-4ce4-9516-63c993dd2efc admin admin] PATH_INFO: `/v3/projects/0cff2813da314c7f8f29bf93336cc648/users/5bae95d1149946b28028571309385f7b/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.658767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615acb78-e035-4b8f-9c1e-eca95e657c36 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.669799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.670192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a16dc2-08d6-4ce4-9516-63c993dd2efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff2813da314c7f8f29bf93336cc648, user_id=5bae95d1149946b28028571309385f7b, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.672253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.672253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.672253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.672253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:38.672253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.673398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a16dc2-08d6-4ce4-9516-63c993dd2efc admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.674058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.689041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 951/1924] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:27:38.693484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.705832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079a33d-6a15-45e7-a7a4-e8420d517773 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.717664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.718507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.718900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.719175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.719835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.722597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:38.784418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 974/1925] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:38 2022] PUT /identity/v3/projects/0cff2813da314c7f8f29bf93336cc648/users/5bae95d1149946b28028571309385f7b/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:38.795525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005ef1-340f-4a5b-93d8-8ae5dcda5b8f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.795811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005ef1-340f-4a5b-93d8-8ae5dcda5b8f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.796086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005ef1-340f-4a5b-93d8-8ae5dcda5b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.827002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4b005ef1-340f-4a5b-93d8-8ae5dcda5b8f None None] MFA Rules not processed for user `5bae95d1149946b28028571309385f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:38.828510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4b005ef1-340f-4a5b-93d8-8ae5dcda5b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:38.847995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 952/1926] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:38 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:38.852385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.927247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 975/1927] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:38.928472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005ef1-340f-4a5b-93d8-8ae5dcda5b8f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:38.940184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210b67d-000c-4759-bc64-c19c07ca1e2e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:38.946714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:38.947661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:38.949236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:38.949662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:38.951323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:38.953479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.012969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005ef1-340f-4a5b-93d8-8ae5dcda5b8f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.020039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.020039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.020448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.020740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.021395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.024523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.084192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 953/1928] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:38 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:39.085413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.097347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73633451-b3b7-42f5-bd81-f806c4da821f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.101653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.102306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.102614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.102890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.104567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.106323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.123132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 954/1929] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:39.124521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.134745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0123-bb07-4e49-b1c0-667b4460de9c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.141399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.142272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.142557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.142956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.143481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.145505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.160067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 955/1930] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:27:39.161370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.170556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 976/1931] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:38 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:39.173825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36309794-4621-4d7f-b8e0-acfdb955e6a2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.175978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.249833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fd201-67ce-477e-9166-bc7fe1451770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.250823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd201-67ce-477e-9166-bc7fe1451770 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.251288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd201-67ce-477e-9166-bc7fe1451770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.251691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd201-67ce-477e-9166-bc7fe1451770 admin admin] PATH_INFO: `/v3/projects/2349858e75814ae4bc9357993eb8e9a3/users/eeb5b41d1786456b8c5260f7b94a76d8/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.252799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8176-eed0-41f1-b0eb-71710b9e7f52 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.260635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.261896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.262211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.264216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.264216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.265566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.284334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fd201-67ce-477e-9166-bc7fe1451770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2349858e75814ae4bc9357993eb8e9a3, user_id=eeb5b41d1786456b8c5260f7b94a76d8, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.287997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fd201-67ce-477e-9166-bc7fe1451770 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.421565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 977/1932] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:39 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:39.425584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.437804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a423920-9779-48ea-b566-29f915cad985 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.443457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.444029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.444312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.444774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.445277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.446895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.458933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 978/1933] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:27:39.461173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 956/1934] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:39 2022] PUT /identity/v3/projects/2349858e75814ae4bc9357993eb8e9a3/users/eeb5b41d1786456b8c5260f7b94a76d8/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:39.479203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.481276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5764c-c653-41fa-9f30-89dd94b97e63 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.481565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5764c-c653-41fa-9f30-89dd94b97e63 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.482499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5764c-c653-41fa-9f30-89dd94b97e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.492877 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dbb09-6dd4-490e-b735-263d3504c64d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.526440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-00b5764c-c653-41fa-9f30-89dd94b97e63 None None] MFA Rules not processed for user `eeb5b41d1786456b8c5260f7b94a76d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:39.527955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-00b5764c-c653-41fa-9f30-89dd94b97e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:39.588824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.589505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.589796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.590078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] PATH_INFO: `/v3/projects/0591fc115f854a98a8288ba770934fdf/users/3dbb80c82623446cae9a7d1f202dc2b9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.614062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0591fc115f854a98a8288ba770934fdf, user_id=3dbb80c82623446cae9a7d1f202dc2b9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.618194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.628232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 957/1935] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:39.632885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5764c-c653-41fa-9f30-89dd94b97e63 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.653500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5764c-c653-41fa-9f30-89dd94b97e63 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.662865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.663790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.664180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.664604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.665388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.668983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.766621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:39.838515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 979/1936] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:39 2022] PUT /identity/v3/projects/0591fc115f854a98a8288ba770934fdf/users/3dbb80c82623446cae9a7d1f202dc2b9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:39.839312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 958/1937] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:39 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:39.839475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.841342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:39.970962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd5b3f-5d05-46d9-abf1-385c5ec5b359 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.971137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff384d-de73-4dae-89c1-0506b9f96ea6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:39.976319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.977039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.977317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.977586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.978225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.980620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.991014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:39.991529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:39.995333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:39.995459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 980/1938] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:39.995549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:39.995549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:39.995549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:39.996330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:40.009206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debeea3-0496-40d7-87dc-61ebdb4f5f4c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:40.014811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732dd1e-998e-4977-ae4b-1178bdedcd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:40.015493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dd1e-998e-4977-ae4b-1178bdedcd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.015774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dd1e-998e-4977-ae4b-1178bdedcd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.016052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dd1e-998e-4977-ae4b-1178bdedcd7d admin admin] PATH_INFO: `/v3/projects/0591fc115f854a98a8288ba770934fdf/users/3dbb80c82623446cae9a7d1f202dc2b9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.018147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732dd1e-998e-4977-ae4b-1178bdedcd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0591fc115f854a98a8288ba770934fdf, user_id=3dbb80c82623446cae9a7d1f202dc2b9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:40.021531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732dd1e-998e-4977-ae4b-1178bdedcd7d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:40.034293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 981/1939] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:39 2022] PUT /identity/v3/projects/0591fc115f854a98a8288ba770934fdf/users/3dbb80c82623446cae9a7d1f202dc2b9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:40.046420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.046694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.046968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.084255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] MFA Rules not processed for user `3dbb80c82623446cae9a7d1f202dc2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:40.085300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:40.168970 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 982/1940] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:40.188314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 959/1941] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:39 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:40.188410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:40.188410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:40.189303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:40.203489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dd539-d7d7-4c32-94d5-0bbff0000647 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:40.233156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:40.269127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cb836-5f39-4154-bede-cf90dfdcdd81 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:40.275122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43ddf-c1c6-4038-a4c0-2677c30c76bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:40.275481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43ddf-c1c6-4038-a4c0-2677c30c76bc service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.275771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43ddf-c1c6-4038-a4c0-2677c30c76bc service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.276111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43ddf-c1c6-4038-a4c0-2677c30c76bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.297233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:40.298076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.298840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.298840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.299551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:40.302018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:40.314714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 960/1942] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:27:40.319168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:40.330182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e10a-76d6-45da-a2f1-c600388856fa admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:40.335244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:40.335876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.336165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.336443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.337321 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:40.339449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:40.354968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 961/1943] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:27:40.357413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e43ddf-c1c6-4038-a4c0-2677c30c76bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:40.358919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e43ddf-c1c6-4038-a4c0-2677c30c76bc service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:40.360835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:40.373171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb872f7-52e6-4c3f-b49d-12d5378605ca admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:40.374598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 983/1944] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:40.388699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:40.388699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.388699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.388699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] PATH_INFO: `/v3/projects/d0cadafafcc548d8b5a543f38828becf/users/319f10e026164d5d83a52fa6f8a53120/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.409549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cadafafcc548d8b5a543f38828becf, user_id=319f10e026164d5d83a52fa6f8a53120, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:40.412515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:40.541107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 962/1945] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:40 2022] PUT /identity/v3/projects/d0cadafafcc548d8b5a543f38828becf/users/319f10e026164d5d83a52fa6f8a53120/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:40.551667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421f0e-8100-4584-a856-f4dedc2c5114 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.551988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421f0e-8100-4584-a856-f4dedc2c5114 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.552342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421f0e-8100-4584-a856-f4dedc2c5114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.589517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e9421f0e-8100-4584-a856-f4dedc2c5114 None None] MFA Rules not processed for user `319f10e026164d5d83a52fa6f8a53120`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:40.590659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e9421f0e-8100-4584-a856-f4dedc2c5114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:40.694317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 984/1946] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:40.700048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:40.815356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5873-45f3-4d69-9bfe-c3dcc7c92b58 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:40.820750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:40.821381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.821655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.822099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.823320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:40.825205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:41.060568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 963/1947] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:40 2022] POST /identity/v3/projects => generated 377 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:41.065047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421f0e-8100-4584-a856-f4dedc2c5114 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:41.077361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421f0e-8100-4584-a856-f4dedc2c5114 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:41.189526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:41.190835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:41.190835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:41.191135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:41.191806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:41.193868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:41.426369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 985/1948] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:41 2022] POST /identity/v3/users => generated 295 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:41.427174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:41.438365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0422b4-a809-4d43-84f7-6ddd74c67d2c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:41.443725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:41.444370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:41.444663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:41.444977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:41.445630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:41.447241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:41.458978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 964/1949] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:41.463319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:41.476010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b50a8-f23f-4d18-848c-bdce208c8f21 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:41.481925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:41.482608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:41.482887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:41.483160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] PATH_INFO: `/v3/projects/346b880b916943d4b50d4d709e61d3a8/users/df6dcbebc60b4c5ebb04893ae9e55f27/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:41.501419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346b880b916943d4b50d4d709e61d3a8, user_id=df6dcbebc60b4c5ebb04893ae9e55f27, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:41.504289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:41.634435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 986/1950] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:41 2022] PUT /identity/v3/projects/346b880b916943d4b50d4d709e61d3a8/users/df6dcbebc60b4c5ebb04893ae9e55f27/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:41.639095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:41.655818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d1247-9937-4ffa-9baa-5f78c79066a8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:41.719901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc494-d4ed-488a-a12f-ac9522d5b729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:41.720567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc494-d4ed-488a-a12f-ac9522d5b729 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:41.720921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc494-d4ed-488a-a12f-ac9522d5b729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:41.721200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc494-d4ed-488a-a12f-ac9522d5b729 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:41.721913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecc494-d4ed-488a-a12f-ac9522d5b729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:41.723568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecc494-d4ed-488a-a12f-ac9522d5b729 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:41.735088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 965/1951] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:41.739759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:41.750788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0f36-2fd2-437e-acd3-7b38dd6e3dc7 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:41.755710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:41.756394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:41.756659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:41.756968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] PATH_INFO: `/v3/projects/346b880b916943d4b50d4d709e61d3a8/users/df6dcbebc60b4c5ebb04893ae9e55f27/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:41.758912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=346b880b916943d4b50d4d709e61d3a8, user_id=df6dcbebc60b4c5ebb04893ae9e55f27, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:41.762298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:41.774394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 987/1952] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:41 2022] PUT /identity/v3/projects/346b880b916943d4b50d4d709e61d3a8/users/df6dcbebc60b4c5ebb04893ae9e55f27/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:41.786687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:41.786978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:41.787261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:41.825287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] MFA Rules not processed for user `df6dcbebc60b4c5ebb04893ae9e55f27`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:41.826519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:41.918184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 966/1953] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:41.930453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:41.993160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6226f-66bb-419d-80ee-a3d362763fda admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:41.997498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:41.998125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:41.998401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:41.998670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:42.009028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:42.018834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:42.027604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 988/1954] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:42.206062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:42.207478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:42.219841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86cb7e-4914-4642-a036-8a7d5252ce59 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:42.223444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe36a67-0ec0-4440-baa8-6f36f74145e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:42.224065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36a67-0ec0-4440-baa8-6f36f74145e8 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:42.224361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36a67-0ec0-4440-baa8-6f36f74145e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:42.224636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36a67-0ec0-4440-baa8-6f36f74145e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:42.296161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe36a67-0ec0-4440-baa8-6f36f74145e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:42.297727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe36a67-0ec0-4440-baa8-6f36f74145e8 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:42.308836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 967/1955] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:42.421059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:43.274440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:46.283598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:46.386960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:46.460652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dfa4b-6cc1-40c7-8e9e-7fd6cab21ba9 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:46.466188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:46.466899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:46.467173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:46.467491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] PATH_INFO: `/v3/users/5bae95d1149946b28028571309385f7b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:46.468634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bae95d1149946b28028571309385f7b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:46.471257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:46.785079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bae95d1149946b28028571309385f7b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:46.785755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bae95d1149946b28028571309385f7b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:46.920071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bae95d1149946b28028571309385f7b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:46.920751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bae95d1149946b28028571309385f7b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:46.930901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bae95d1149946b28028571309385f7b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:46.959700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 989/1956] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:46 2022] DELETE /identity/v3/users/5bae95d1149946b28028571309385f7b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:46.967577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:46.968652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:46.969151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:47.005472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:47.006970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:47.102815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 968/1957] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:47.115773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:47.117681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:47.218043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aa38f-fb47-497d-804c-dc48e30d7061 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:47.223821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:47.224453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:47.224788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:47.225063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:47.236618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:47.238256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:47.249620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 990/1958] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:47.521212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:47.813993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:47.815673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:47.827582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a857-0bc0-4a15-8899-11cf3e98c288 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:47.832840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:47.833477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:47.833762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:47.834030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] PATH_INFO: `/v3/projects/0cff2813da314c7f8f29bf93336cc648` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:47.835233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cff2813da314c7f8f29bf93336cc648)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:47.837206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:47.982829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cff2813da314c7f8f29bf93336cc648', 'request_id': 'req-ca445aae-697a-47fa-9925-026d7b71f862'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:47.991233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cff2813da314c7f8f29bf93336cc648', 'request_id': 'req-ca445aae-697a-47fa-9925-026d7b71f862'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.153704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cff2813da314c7f8f29bf93336cc648', 'request_id': 'req-ca445aae-697a-47fa-9925-026d7b71f862'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.165854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] The token cache is being invalidate because project 0cff2813da314c7f8f29bf93336cc648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:48.175333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.175333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.175333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 969/1959] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:47 2022] DELETE /identity/v3/projects/0cff2813da314c7f8f29bf93336cc648 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:48.175617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:48.183405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98a223-f9b1-4cc4-b03a-7ca0c32c9a89 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:48.253041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:48.253719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:48.254001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:48.254275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] PATH_INFO: `/v3/users/3dbb80c82623446cae9a7d1f202dc2b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:48.255492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbb80c82623446cae9a7d1f202dc2b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:48.257489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:48.632581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbb80c82623446cae9a7d1f202dc2b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.633404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbb80c82623446cae9a7d1f202dc2b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.767888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:48.769683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:48.787952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca445aae-697a-47fa-9925-026d7b71f862 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:48.794512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:48.795351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:48.795621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:48.795985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] PATH_INFO: `/v3/users/eeb5b41d1786456b8c5260f7b94a76d8` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:48.798327 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb5b41d1786456b8c5260f7b94a76d8)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:48.800603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:48.809950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbb80c82623446cae9a7d1f202dc2b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.810933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbb80c82623446cae9a7d1f202dc2b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.821059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a499318f-a155-4f0a-a404-796c207499d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbb80c82623446cae9a7d1f202dc2b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:48.844985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 991/1960] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:48 2022] DELETE /identity/v3/users/3dbb80c82623446cae9a7d1f202dc2b9 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:49.077375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb5b41d1786456b8c5260f7b94a76d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:49.197348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb5b41d1786456b8c5260f7b94a76d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:49.198850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb5b41d1786456b8c5260f7b94a76d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:49.217085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb5b41d1786456b8c5260f7b94a76d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:49.225609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb5b41d1786456b8c5260f7b94a76d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:49.234242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 970/1961] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:48 2022] DELETE /identity/v3/users/eeb5b41d1786456b8c5260f7b94a76d8 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:49.243138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:49.253525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:49.253525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:49.265346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:49.266811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:49.346943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 992/1962] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:49.358494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:49.359932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:49.433186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7a68a-e27e-4df2-bede-87dcf7d656fe admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:49.438649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58bd7f-902c-4ef3-a8c3-914a1f672b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:49.438649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58bd7f-902c-4ef3-a8c3-914a1f672b37 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:49.438649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58bd7f-902c-4ef3-a8c3-914a1f672b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:49.438649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58bd7f-902c-4ef3-a8c3-914a1f672b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:49.451351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58bd7f-902c-4ef3-a8c3-914a1f672b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:49.452886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58bd7f-902c-4ef3-a8c3-914a1f672b37 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:49.464639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 971/1963] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:49.651509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:49.651509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:49.651509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc193ea-7228-45ca-b66c-bf5e767f22a7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:49.652430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:49.653104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:49.653388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:49.653687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] PATH_INFO: `/v3/projects/0591fc115f854a98a8288ba770934fdf` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:49.655108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0591fc115f854a98a8288ba770934fdf)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:49.657234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:49.885384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:49.911120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0591fc115f854a98a8288ba770934fdf', 'request_id': 'req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:49.920016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0591fc115f854a98a8288ba770934fdf', 'request_id': 'req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:49.927362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0591fc115f854a98a8288ba770934fdf', 'request_id': 'req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.055253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] The token cache is being invalidate because project 0591fc115f854a98a8288ba770934fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:50.055697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.056395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4227fb9f-9327-45ba-8116-63c0ec0e9ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.059086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 993/1964] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:49 2022] DELETE /identity/v3/projects/0591fc115f854a98a8288ba770934fdf => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:50.064353 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2f65-1baa-4635-8ffa-b231ae02bc7c None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.064657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2f65-1baa-4635-8ffa-b231ae02bc7c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.065140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e2f65-1baa-4635-8ffa-b231ae02bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.086330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-fd2e2f65-1baa-4635-8ffa-b231ae02bc7c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:50.087642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fd2e2f65-1baa-4635-8ffa-b231ae02bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:50.154650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 972/1965] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:50.163457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.163737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.164009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.185195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:50.193612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:50.195276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 994/1966] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:50.199746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2f65-1baa-4635-8ffa-b231ae02bc7c None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.210074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e2f65-1baa-4635-8ffa-b231ae02bc7c None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.215996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.216627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.216939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.217206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.217854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:50.218155 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.219842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:50.228296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.230990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:50.238968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 973/1967] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:27:50.240453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.249618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af42b7-156f-429f-807e-2100a34caa49 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.252446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f10f3-8f78-4421-ae62-15a55c9632ea admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.257996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.259028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.259505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.259952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] PATH_INFO: `/v3/projects/2349858e75814ae4bc9357993eb8e9a3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.261588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.262047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2349858e75814ae4bc9357993eb8e9a3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.262272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.262561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.263404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.264212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.265981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:50.266186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:50.433106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 974/1968] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:50 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:50.438666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.442630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2349858e75814ae4bc9357993eb8e9a3', 'request_id': 'req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.450897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2349858e75814ae4bc9357993eb8e9a3', 'request_id': 'req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.461296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2349858e75814ae4bc9357993eb8e9a3', 'request_id': 'req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.517910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde069c-5a86-4d90-be3d-7acba7fad389 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.518585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.519407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.520652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.520652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.521035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.523353 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:50.607162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] The token cache is being invalidate because project 2349858e75814ae4bc9357993eb8e9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:50.607162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.607162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:50.607162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 995/1969] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:50 2022] DELETE /identity/v3/projects/2349858e75814ae4bc9357993eb8e9a3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:50.609888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.611421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:50.686246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc66f-96e2-40bb-aba1-31ee104be8d3 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.691654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.692551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.692872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.693271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] PATH_INFO: `/v3/users/319f10e026164d5d83a52fa6f8a53120` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.694619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=319f10e026164d5d83a52fa6f8a53120)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.696572 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:50.711877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 975/1970] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:50 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:50.719643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.728756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:50.743802 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d61a8-191a-40f5-9012-0d72eb806aa1 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.751255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.752199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.752573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.753367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.754779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.756597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:50.784498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 976/1971] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:50.789309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.803535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa945d2-87a9-4f4a-a074-1bad02c3b397 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.810382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.811085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.811424 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.811769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.812447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.814096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:50.827739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 977/1972] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:50.832857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:50.844996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bf99-e271-48f4-a967-20a6c98a3a36 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:50.856784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee067c5-bad5-4fed-b6b0-97b4a97766c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:50.857475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee067c5-bad5-4fed-b6b0-97b4a97766c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:50.857762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee067c5-bad5-4fed-b6b0-97b4a97766c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:50.858095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee067c5-bad5-4fed-b6b0-97b4a97766c8 admin admin] PATH_INFO: `/v3/projects/9e9424e2281c4af3948dcb9dcf5bd215/users/43a7beae30f34bc9b9eb6b1b843038d8/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:50.884985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee067c5-bad5-4fed-b6b0-97b4a97766c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9424e2281c4af3948dcb9dcf5bd215, user_id=43a7beae30f34bc9b9eb6b1b843038d8, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:50.892621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee067c5-bad5-4fed-b6b0-97b4a97766c8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:51.061577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 978/1973] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:50 2022] PUT /identity/v3/projects/9e9424e2281c4af3948dcb9dcf5bd215/users/43a7beae30f34bc9b9eb6b1b843038d8/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:51.075474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f14a-bf56-4e20-908a-606b746313be None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:51.075762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f14a-bf56-4e20-908a-606b746313be None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:51.076043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f14a-bf56-4e20-908a-606b746313be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:51.112386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6926f14a-bf56-4e20-908a-606b746313be None None] MFA Rules not processed for user `43a7beae30f34bc9b9eb6b1b843038d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:51.113434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319f10e026164d5d83a52fa6f8a53120'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:51.114002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319f10e026164d5d83a52fa6f8a53120'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:51.114234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6926f14a-bf56-4e20-908a-606b746313be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:51.204281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 979/1974] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:51.216516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f14a-bf56-4e20-908a-606b746313be None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:51.218019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6926f14a-bf56-4e20-908a-606b746313be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:51.242955 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319f10e026164d5d83a52fa6f8a53120'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:51.246328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319f10e026164d5d83a52fa6f8a53120'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:51.255173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319f10e026164d5d83a52fa6f8a53120'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:51.276718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 996/1975] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:50 2022] DELETE /identity/v3/users/319f10e026164d5d83a52fa6f8a53120 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:51.301280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f14a-bf56-4e20-908a-606b746313be None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:51.371435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:51.372072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:51.372354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:51.372627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:51.412867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:51.445029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:51.446503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:51.457871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 980/1976] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:27:51.913710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:51.914593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:52.014221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b02b4-4740-40a5-824b-70e29f3bee61 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:52.019283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:52.020190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:52.020472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:52.020779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] PATH_INFO: `/v3/projects/d0cadafafcc548d8b5a543f38828becf` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:52.021940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cadafafcc548d8b5a543f38828becf)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:52.023871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:52.177460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cadafafcc548d8b5a543f38828becf', 'request_id': 'req-052c8b14-08a1-4ce3-b668-9218309bf866'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:52.184845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cadafafcc548d8b5a543f38828becf', 'request_id': 'req-052c8b14-08a1-4ce3-b668-9218309bf866'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:52.191635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cadafafcc548d8b5a543f38828becf', 'request_id': 'req-052c8b14-08a1-4ce3-b668-9218309bf866'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:52.380126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] The token cache is being invalidate because project d0cadafafcc548d8b5a543f38828becf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:52.380886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:52.381136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:52.383170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 997/1977] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:51 2022] DELETE /identity/v3/projects/d0cadafafcc548d8b5a543f38828becf => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:52.387774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:52.402199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12d832-b2f9-4a90-8d55-9f530089bc67 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:52.465602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:52.466308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:52.466541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:52.466817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] PATH_INFO: `/v3/users/df6dcbebc60b4c5ebb04893ae9e55f27` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:52.467966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6dcbebc60b4c5ebb04893ae9e55f27)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:52.469983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:52.828027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6dcbebc60b4c5ebb04893ae9e55f27'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:52.993701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6dcbebc60b4c5ebb04893ae9e55f27'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:52.995055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6dcbebc60b4c5ebb04893ae9e55f27'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:53.013915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6dcbebc60b4c5ebb04893ae9e55f27'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:53.025338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d827f61b-e28f-4cd0-8dd2-0f2dab70efe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6dcbebc60b4c5ebb04893ae9e55f27'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:53.035108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 981/1978] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:52 2022] DELETE /identity/v3/users/df6dcbebc60b4c5ebb04893ae9e55f27 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:53.658453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:53.660385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:53.680684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c8b14-08a1-4ce3-b668-9218309bf866 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:53.764825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:53.765407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:53.765696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:53.765959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] PATH_INFO: `/v3/projects/346b880b916943d4b50d4d709e61d3a8` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:53.767131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346b880b916943d4b50d4d709e61d3a8)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:53.774736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:53.947049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346b880b916943d4b50d4d709e61d3a8', 'request_id': 'req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:53.954027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346b880b916943d4b50d4d709e61d3a8', 'request_id': 'req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:53.962330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346b880b916943d4b50d4d709e61d3a8', 'request_id': 'req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:54.105928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] The token cache is being invalidate because project 346b880b916943d4b50d4d709e61d3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:54.106227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:54.107025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-89c740a7-d1a0-4cbb-9fb8-0457bf545f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:54.108567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 998/1979] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:53 2022] DELETE /identity/v3/projects/346b880b916943d4b50d4d709e61d3a8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:54.115584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7653e4-9296-45bd-b444-115836820875 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.116084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7653e4-9296-45bd-b444-115836820875 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.116246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7653e4-9296-45bd-b444-115836820875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.148641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ef7653e4-9296-45bd-b444-115836820875 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:54.151441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ef7653e4-9296-45bd-b444-115836820875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:54.230354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 982/1980] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:54.238837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdfefd-c517-47f8-9889-73d365434da7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.242127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdfefd-c517-47f8-9889-73d365434da7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.242127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdfefd-c517-47f8-9889-73d365434da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.266994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-eecdfefd-c517-47f8-9889-73d365434da7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:54.268285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-eecdfefd-c517-47f8-9889-73d365434da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:54.281488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 999/1981] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:54.283109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7653e4-9296-45bd-b444-115836820875 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:54.283972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:54.299356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7653e4-9296-45bd-b444-115836820875 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:54.305823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:54.306390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.306665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.307557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.308260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:54.308616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:54.310459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:54.324985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 983/1982] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:27:54.329981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdfefd-c517-47f8-9889-73d365434da7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:54.340821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdfefd-c517-47f8-9889-73d365434da7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:54.346048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:54.368180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.368180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.368180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.368180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:54.368180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:54.577851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1000/1983] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:54 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:54.585213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:54.600045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0296-bad2-4e98-ab2d-990a6a280a6a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:54.664273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:54.664940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.665215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.665485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.666122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:54.668928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:54.806947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 984/1984] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:54 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:54.813220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:54.833996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0ca05-a1f3-4528-a8a9-9f223e075254 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:54.842707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:54.843171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.843458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.843731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.844708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:54.847474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:54.867088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1001/1985] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:54.872590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:54.887345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030b8d-324c-4413-b855-3ffede1dd4df admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:54.898888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f674663-d6a3-4491-9776-1795cf0083a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:54.899612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f674663-d6a3-4491-9776-1795cf0083a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.899783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f674663-d6a3-4491-9776-1795cf0083a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.900054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f674663-d6a3-4491-9776-1795cf0083a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.901372 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f674663-d6a3-4491-9776-1795cf0083a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:54.903000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f674663-d6a3-4491-9776-1795cf0083a2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:54.915741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 985/1986] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:54.921948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:54.932401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6486c7-da69-44ee-a773-9132b1c08232 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:54.938515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:54.939194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:54.940070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:54.940372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] PATH_INFO: `/v3/projects/733037ac0cab442b9bf7d773fc2ec65c/users/790029c00d264de49d1d423434fad0a7/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:54.967540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=733037ac0cab442b9bf7d773fc2ec65c, user_id=790029c00d264de49d1d423434fad0a7, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:54.967540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:55.032513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:55.088870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1002/1987] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:54 2022] PUT /identity/v3/projects/733037ac0cab442b9bf7d773fc2ec65c/users/790029c00d264de49d1d423434fad0a7/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:55.095360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc4ce-bcd2-46d8-8c2e-f59a7b757c43 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:55.095651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc4ce-bcd2-46d8-8c2e-f59a7b757c43 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:55.095924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc4ce-bcd2-46d8-8c2e-f59a7b757c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:55.128981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8fddc4ce-bcd2-46d8-8c2e-f59a7b757c43 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:55.130300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8fddc4ce-bcd2-46d8-8c2e-f59a7b757c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:55.202487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 986/1988] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:55.212296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:55.214238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:55.297589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661810-899d-48d8-af23-82a8145d5d5a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:55.301964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:55.302868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:55.303157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:55.303439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:55.314288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:55.315761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:55.328422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1003/1989] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:57.509578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b813-5711-4ab9-9d25-7bd810102c9d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:57.510996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b813-5711-4ab9-9d25-7bd810102c9d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:57.511465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b813-5711-4ab9-9d25-7bd810102c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:57.556491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7f29b813-5711-4ab9-9d25-7bd810102c9d None None] MFA Rules not processed for user `790029c00d264de49d1d423434fad0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:57.558931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7f29b813-5711-4ab9-9d25-7bd810102c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:57.593700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:57.639200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 987/1990] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:57.643914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:57.661688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c135d-be55-4235-9412-d94eb45043b0 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:57.667890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:57.668377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:57.668660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:57.669459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:57.670346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:57.672524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:57.794043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1004/1991] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:57 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:57.795303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b813-5711-4ab9-9d25-7bd810102c9d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:57.813396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b813-5711-4ab9-9d25-7bd810102c9d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:57.874008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:57.922226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:57.923444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:57.923917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:57.924552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:57.925648 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:57.931266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:58.056244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 988/1992] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:57 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:58.057786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:58.090401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b139-7dde-4a84-8da1-7ca31abc9a11 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:58.105103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:58.106125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:58.106610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:58.107083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:58.110062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:58.118169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:58.161992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1005/1993] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:58.169892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:58.202397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3c9ff-34e0-4e3f-83b2-58f086e32111 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:58.208594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:58.209936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:58.210472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:58.211064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] PATH_INFO: `/v3/projects/a2334b8db8264390827f492d001a486c/users/588c3224c0db4972b78957b483a873c9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:58.243194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2334b8db8264390827f492d001a486c, user_id=588c3224c0db4972b78957b483a873c9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:58.263637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:58.437436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 989/1994] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:58 2022] PUT /identity/v3/projects/a2334b8db8264390827f492d001a486c/users/588c3224c0db4972b78957b483a873c9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:58.442779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:58.455774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f654ec-955a-4b07-94e5-c830ac532a71 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:58.518251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244783c6-73f2-4e01-829b-600b94ccf6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:58.519018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244783c6-73f2-4e01-829b-600b94ccf6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:58.519404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244783c6-73f2-4e01-829b-600b94ccf6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:58.520277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244783c6-73f2-4e01-829b-600b94ccf6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:58.521011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244783c6-73f2-4e01-829b-600b94ccf6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:58.522763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244783c6-73f2-4e01-829b-600b94ccf6a8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:58.533922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1006/1995] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:58.538111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:58.550100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5355-50e2-4f61-a5c3-fc1a51d3e6c1 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:58.555014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa7fbf-47bb-480f-9776-3f8129244218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:58.555709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa7fbf-47bb-480f-9776-3f8129244218 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:58.555988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa7fbf-47bb-480f-9776-3f8129244218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:58.556259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa7fbf-47bb-480f-9776-3f8129244218 admin admin] PATH_INFO: `/v3/projects/a2334b8db8264390827f492d001a486c/users/588c3224c0db4972b78957b483a873c9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:58.558922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa7fbf-47bb-480f-9776-3f8129244218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2334b8db8264390827f492d001a486c, user_id=588c3224c0db4972b78957b483a873c9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:58.561631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa7fbf-47bb-480f-9776-3f8129244218 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:58.575124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 990/1996] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:58 2022] PUT /identity/v3/projects/a2334b8db8264390827f492d001a486c/users/588c3224c0db4972b78957b483a873c9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:58.588295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9b3e-f502-4ae8-808c-8cc1ddd5f2cf None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:58.588612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9b3e-f502-4ae8-808c-8cc1ddd5f2cf None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:58.588917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9b3e-f502-4ae8-808c-8cc1ddd5f2cf None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:58.591142 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1007/1997] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:27:58.606877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:58.607221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:58.607696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:58.641964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:58.645719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:58.724306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 991/1998] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:58.735430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9b3e-f502-4ae8-808c-8cc1ddd5f2cf None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:58.737374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8a4c9b3e-f502-4ae8-808c-8cc1ddd5f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:58.755386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9b3e-f502-4ae8-808c-8cc1ddd5f2cf None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:58.762041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:58.763001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:58.763001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:58.763349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:58.772914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:58.774557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:58.785538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1008/1999] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:58.919063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:58.921378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:59.006315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7479d8-7c88-45be-9ee2-9a8125a6734e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:59.012088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:59.012970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:59.013255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:59.013523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] PATH_INFO: `/v3/users/ba52c5881d6c42b5ac50272d4bc48ae7` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:59.014784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba52c5881d6c42b5ac50272d4bc48ae7)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:59.016892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:59.364100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba52c5881d6c42b5ac50272d4bc48ae7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:59.482765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba52c5881d6c42b5ac50272d4bc48ae7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:59.483473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba52c5881d6c42b5ac50272d4bc48ae7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:59.505978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba52c5881d6c42b5ac50272d4bc48ae7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:59.514496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e798c44e-f55e-44d4-b4bc-6651ee1834a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba52c5881d6c42b5ac50272d4bc48ae7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:59.524144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 992/2000] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:58 2022] DELETE /identity/v3/users/ba52c5881d6c42b5ac50272d4bc48ae7 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:59.868759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:59.887721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d0f0-0e9d-4d6f-854b-c5e8c46520ed service placement] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:59.959699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:59.973186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:59.973949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:59.974460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:59.974825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] PATH_INFO: `/v3/projects/db59729a0e314b5a8cdad6b0aec4bf0b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:59.976238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db59729a0e314b5a8cdad6b0aec4bf0b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:59.978402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:00.171266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db59729a0e314b5a8cdad6b0aec4bf0b', 'request_id': 'req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:00.178195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db59729a0e314b5a8cdad6b0aec4bf0b', 'request_id': 'req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:00.186288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db59729a0e314b5a8cdad6b0aec4bf0b', 'request_id': 'req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:00.284830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] The token cache is being invalidate because project db59729a0e314b5a8cdad6b0aec4bf0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:00.285119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:00.285771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2edb7121-9d4c-4c02-90e4-e0545ec7ebf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:00.287283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1009/2001] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:59 2022] DELETE /identity/v3/projects/db59729a0e314b5a8cdad6b0aec4bf0b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:00.292974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fa476-e1fe-4a4e-87e2-821b04036b36 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:00.293262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fa476-e1fe-4a4e-87e2-821b04036b36 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:00.293621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fa476-e1fe-4a4e-87e2-821b04036b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:00.317780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-935fa476-e1fe-4a4e-87e2-821b04036b36 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:00.319261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-935fa476-e1fe-4a4e-87e2-821b04036b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:00.387629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 993/2002] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:00.395912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffe2c3-d2c3-46ef-a7cb-e050a192db04 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:00.396235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffe2c3-d2c3-46ef-a7cb-e050a192db04 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:00.396504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffe2c3-d2c3-46ef-a7cb-e050a192db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:00.418351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e4ffe2c3-d2c3-46ef-a7cb-e050a192db04 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:00.419650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e4ffe2c3-d2c3-46ef-a7cb-e050a192db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:00.429661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1010/2003] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:00.434467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fa476-e1fe-4a4e-87e2-821b04036b36 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:00.445114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fa476-e1fe-4a4e-87e2-821b04036b36 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:00.450290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572625f3-06e8-4602-9b8a-d26fe04c1e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:00.450957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572625f3-06e8-4602-9b8a-d26fe04c1e10 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:00.451187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572625f3-06e8-4602-9b8a-d26fe04c1e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:00.451460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572625f3-06e8-4602-9b8a-d26fe04c1e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:00.452950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572625f3-06e8-4602-9b8a-d26fe04c1e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:00.453279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572625f3-06e8-4602-9b8a-d26fe04c1e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:00.455106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572625f3-06e8-4602-9b8a-d26fe04c1e10 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:00.472619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 994/2004] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:28:00.477542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffe2c3-d2c3-46ef-a7cb-e050a192db04 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:00.488841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffe2c3-d2c3-46ef-a7cb-e050a192db04 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:00.494064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:00.495419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:00.495831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:00.496116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:00.496801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:00.498731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:00.686544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48ea1-15f9-4190-a562-0e6257f2b0f7 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:00.686663 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1011/2005] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:00 2022] POST /identity/v3/projects => generated 403 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:00.686739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48ea1-15f9-4190-a562-0e6257f2b0f7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:00.686988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48ea1-15f9-4190-a562-0e6257f2b0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:00.690618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:00.729406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-53f48ea1-15f9-4190-a562-0e6257f2b0f7 None None] MFA Rules not processed for user `588c3224c0db4972b78957b483a873c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:00.731506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-53f48ea1-15f9-4190-a562-0e6257f2b0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:00.803900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306cd68-d0ef-4ca6-9104-48cfe9973a3f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:00.814286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:00.815289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:00.815575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:00.815926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:00.816521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:00.818660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:00.831670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 995/2006] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:00.834801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:00.843677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:00.843994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:00.849627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:00.872816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] MFA Rules not processed for user `790029c00d264de49d1d423434fad0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:00.874067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:00.937784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 996/2007] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:00.954419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:00.963473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:01.007227 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1012/2008] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:00 2022] POST /identity/v3/users => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:28:01.008749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:01.020652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4674cf-915d-40d6-a1b9-d9dc34dc81b3 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:01.027835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:01.027835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:01.028098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:01.028171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:01.029025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:01.030762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:01.041608 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c6d8e-52d1-480e-970f-b88b5ec82d14 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:01.046182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1013/2009] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:01.046720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:01.050894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b64d-c5c7-4902-8418-e271631b7072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:01.051713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b64d-c5c7-4902-8418-e271631b7072 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:01.051998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b64d-c5c7-4902-8418-e271631b7072 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:01.052276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b64d-c5c7-4902-8418-e271631b7072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:01.055075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7269b64d-c5c7-4902-8418-e271631b7072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:01.057778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f61d-a112-4162-9dc8-a73be455f1a4 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:01.062755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:01.063358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:01.063636 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:01.063904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:01.064580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:01.066272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:01.067611 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b64d-c5c7-4902-8418-e271631b7072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:01.069251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b64d-c5c7-4902-8418-e271631b7072 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:01.078089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1014/2010] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:01.081659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 997/2011] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:28:01.087102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:01.098397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac15b7a-833f-4fa0-8b68-f233e3936572 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:01.103464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:01.104129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:01.104427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:01.104704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] PATH_INFO: `/v3/projects/48114e2c011241d0a5185e8d58b814f6/users/d40cb5c5714e48f795ea1699661525ea/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:01.124862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=48114e2c011241d0a5185e8d58b814f6, user_id=d40cb5c5714e48f795ea1699661525ea, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:01.127689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:01.286928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1015/2012] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:01 2022] PUT /identity/v3/projects/48114e2c011241d0a5185e8d58b814f6/users/d40cb5c5714e48f795ea1699661525ea/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:01.300309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1fe46-0db6-48fc-91e6-360d53343ac0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:01.300838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1fe46-0db6-48fc-91e6-360d53343ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:01.301378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1fe46-0db6-48fc-91e6-360d53343ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:01.327086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a2e1fe46-0db6-48fc-91e6-360d53343ac0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:01.328362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a2e1fe46-0db6-48fc-91e6-360d53343ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:01.419590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 998/2013] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:01.430036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:01.432771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:01.505980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca928e02-d7fa-4eb8-b80b-825c999864ac admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:01.510683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:01.511456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:01.511773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:01.512061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:01.524031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:01.526460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:01.536986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1016/2014] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:02.308351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:03.269720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700265-961e-49df-978e-e59665a62831 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:03.270565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700265-961e-49df-978e-e59665a62831 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:03.270644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700265-961e-49df-978e-e59665a62831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:03.310379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-df700265-961e-49df-978e-e59665a62831 None None] MFA Rules not processed for user `d40cb5c5714e48f795ea1699661525ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:03.311932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-df700265-961e-49df-978e-e59665a62831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:03.398993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 999/2015] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:03.411929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:03.425723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b3dad-d91b-449e-846a-dc753f014edc service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:03.433036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:03.434165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:03.445622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:03.445622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:03.445622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:03.445622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:03.626769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1017/2016] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:03 2022] POST /identity/v3/projects => generated 403 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:03.630816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df700265-961e-49df-978e-e59665a62831 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:03.644346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df700265-961e-49df-978e-e59665a62831 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:03.716426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:03.717266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:03.717476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:03.717754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:03.718503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:03.720425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:03.857316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1000/2017] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:03 2022] POST /identity/v3/users => generated 308 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:03.868102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:03.881665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4207b-2cad-48ab-aa7a-6eee5382fd09 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:03.887748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:03.888414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:03.888644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:03.889101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:03.890121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:03.892624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:03.904705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1018/2018] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:03.908165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:03.918749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb5c5b-7629-44ae-b3e8-98901e72e6a2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:03.923663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:03.924261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:03.924605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:03.924942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] PATH_INFO: `/v3/projects/7e6754eda34c4e8299caa0f5420962f2/users/488c6d4409fa47eabf219ca08b6a2a86/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:03.942173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6754eda34c4e8299caa0f5420962f2, user_id=488c6d4409fa47eabf219ca08b6a2a86, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:03.944911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:04.685415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1001/2019] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:03 2022] PUT /identity/v3/projects/7e6754eda34c4e8299caa0f5420962f2/users/488c6d4409fa47eabf219ca08b6a2a86/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:04.686435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:04.699382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859f7e9-4b53-465a-9efb-5613e2d4875c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:04.796791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89d53-fa30-4ca3-9bca-ea5a7ae8d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:04.797535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89d53-fa30-4ca3-9bca-ea5a7ae8d5bc admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:04.798053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89d53-fa30-4ca3-9bca-ea5a7ae8d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:04.798476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89d53-fa30-4ca3-9bca-ea5a7ae8d5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:04.799142 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89d53-fa30-4ca3-9bca-ea5a7ae8d5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:04.801418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89d53-fa30-4ca3-9bca-ea5a7ae8d5bc admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:04.815261 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1019/2020] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:04.820024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:04.840887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34a306-55e7-4d14-99c0-904cf7b28032 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:04.852689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:04.853534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:04.856412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:04.856412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] PATH_INFO: `/v3/projects/7e6754eda34c4e8299caa0f5420962f2/users/488c6d4409fa47eabf219ca08b6a2a86/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:04.857360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6754eda34c4e8299caa0f5420962f2, user_id=488c6d4409fa47eabf219ca08b6a2a86, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:04.860214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:04.873841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1002/2021] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:04 2022] PUT /identity/v3/projects/7e6754eda34c4e8299caa0f5420962f2/users/488c6d4409fa47eabf219ca08b6a2a86/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:04.979557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:06.855659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:06.953963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858a7c-9c6f-4d86-b264-d6eab6b1bdb2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:06.954690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858a7c-9c6f-4d86-b264-d6eab6b1bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:06.954978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858a7c-9c6f-4d86-b264-d6eab6b1bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:06.992342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b2858a7c-9c6f-4d86-b264-d6eab6b1bdb2 None None] MFA Rules not processed for user `488c6d4409fa47eabf219ca08b6a2a86`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:06.992342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b2858a7c-9c6f-4d86-b264-d6eab6b1bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:07.083538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1020/2022] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:08.778273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:08.883144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:08.969215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb82684-77a8-40fe-a398-1fdbfdca8406 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:08.975206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:08.975931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:08.976406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:08.976773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] PATH_INFO: `/v3/users/d40cb5c5714e48f795ea1699661525ea` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:08.979610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40cb5c5714e48f795ea1699661525ea)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:08.981791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:09.347938 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40cb5c5714e48f795ea1699661525ea'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:09.502485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40cb5c5714e48f795ea1699661525ea'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:09.503386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40cb5c5714e48f795ea1699661525ea'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:09.518459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40cb5c5714e48f795ea1699661525ea'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:09.527741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40cb5c5714e48f795ea1699661525ea'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:09.535038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1003/2023] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:08 2022] DELETE /identity/v3/users/d40cb5c5714e48f795ea1699661525ea => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:09.848499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2858a7c-9c6f-4d86-b264-d6eab6b1bdb2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:09.893065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2858a7c-9c6f-4d86-b264-d6eab6b1bdb2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:09.953214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:09.960436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:09.985066 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:09.985828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:09.986221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:09.986590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] PATH_INFO: `/v3/projects/48114e2c011241d0a5185e8d58b814f6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:09.990700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48114e2c011241d0a5185e8d58b814f6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:09.996876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:10.053552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e5a8f-bb33-42fc-8949-e1523703235a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:10.060194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:10.061460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:10.061945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:10.062229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] PATH_INFO: `/v3/users/bb2ddf02647947d099857eac9a2f39ac` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:10.063611 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2ddf02647947d099857eac9a2f39ac)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:10.065721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:10.225144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48114e2c011241d0a5185e8d58b814f6', 'request_id': 'req-a3f138ad-78c3-4614-a0a6-c4bde0a14091'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.232430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48114e2c011241d0a5185e8d58b814f6', 'request_id': 'req-a3f138ad-78c3-4614-a0a6-c4bde0a14091'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.239358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48114e2c011241d0a5185e8d58b814f6', 'request_id': 'req-a3f138ad-78c3-4614-a0a6-c4bde0a14091'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.356412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] The token cache is being invalidate because project 48114e2c011241d0a5185e8d58b814f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:10.356853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.359122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.363763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1021/2024] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:09 2022] DELETE /identity/v3/projects/48114e2c011241d0a5185e8d58b814f6 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:10.364954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:10.366524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:10.372249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2ddf02647947d099857eac9a2f39ac'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.477550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f138ad-78c3-4614-a0a6-c4bde0a14091 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:10.491478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:10.491478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:10.491478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:10.491478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] PATH_INFO: `/v3/users/488c6d4409fa47eabf219ca08b6a2a86` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:10.492088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] RBAC: Authorizing `identity:delete_user(user_id=488c6d4409fa47eabf219ca08b6a2a86)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:10.493820 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:10.625361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2ddf02647947d099857eac9a2f39ac'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.626003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2ddf02647947d099857eac9a2f39ac'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.640619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2ddf02647947d099857eac9a2f39ac'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.648437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-49509ae2-668d-4fe4-9555-875a6cc9cfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2ddf02647947d099857eac9a2f39ac'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.655635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1004/2025] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:09 2022] DELETE /identity/v3/users/bb2ddf02647947d099857eac9a2f39ac => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:10.659973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:10.660266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:10.660541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:10.671951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:10.683230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:10.684564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:10.763713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1005/2026] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:10.774036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:10.776772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:10.829590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488c6d4409fa47eabf219ca08b6a2a86'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.830451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488c6d4409fa47eabf219ca08b6a2a86'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.845631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebc19c-01e0-4b02-ab72-58fba65a6ae0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:10.849570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:10.853776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:10.853776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:10.853776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:10.853776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:10.875454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:10.877032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:10.888720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1006/2027] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:28:10.971136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488c6d4409fa47eabf219ca08b6a2a86'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.972116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488c6d4409fa47eabf219ca08b6a2a86'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:10.981398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488c6d4409fa47eabf219ca08b6a2a86'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.002543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1022/2028] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:10 2022] DELETE /identity/v3/users/488c6d4409fa47eabf219ca08b6a2a86 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:11.387771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:11.389948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:11.403728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f886a-1a5a-4df6-8740-1a42adcd64df service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:11.482023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:11.482959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:11.483560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:11.483927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] PATH_INFO: `/v3/projects/7e6754eda34c4e8299caa0f5420962f2` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:11.485278 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6754eda34c4e8299caa0f5420962f2)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:11.487210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:11.505488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:11.507578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:11.532341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7af1-0712-4d43-84d0-b4c146f6929b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:11.552885 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:11.554349 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:11.554642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:11.554907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] PATH_INFO: `/v3/projects/bb010a14988747bbaa6e7d8b9cad069b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:11.556141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb010a14988747bbaa6e7d8b9cad069b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:11.558265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:11.645773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:11.705737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6754eda34c4e8299caa0f5420962f2', 'request_id': 'req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.714021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6754eda34c4e8299caa0f5420962f2', 'request_id': 'req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.740589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb010a14988747bbaa6e7d8b9cad069b', 'request_id': 'req-905c87aa-bff6-4f31-9020-de014c4b35bb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.747222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb010a14988747bbaa6e7d8b9cad069b', 'request_id': 'req-905c87aa-bff6-4f31-9020-de014c4b35bb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.754020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb010a14988747bbaa6e7d8b9cad069b', 'request_id': 'req-905c87aa-bff6-4f31-9020-de014c4b35bb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.862545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6754eda34c4e8299caa0f5420962f2', 'request_id': 'req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.877843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] The token cache is being invalidate because project 7e6754eda34c4e8299caa0f5420962f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:11.878140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.878826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-76e1f433-dcee-4dc1-bc18-f115f5ece9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.880396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1007/2029] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:11 2022] DELETE /identity/v3/projects/7e6754eda34c4e8299caa0f5420962f2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:11.886047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3fd42-dc84-4995-919f-89dbb4636c94 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:11.886332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3fd42-dc84-4995-919f-89dbb4636c94 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:11.886608 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3fd42-dc84-4995-919f-89dbb4636c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:11.911999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-83e3fd42-dc84-4995-919f-89dbb4636c94 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:11.911999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-83e3fd42-dc84-4995-919f-89dbb4636c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:11.939853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] The token cache is being invalidate because project bb010a14988747bbaa6e7d8b9cad069b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:11.940146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.944672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-905c87aa-bff6-4f31-9020-de014c4b35bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:11.944672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1023/2030] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:11 2022] DELETE /identity/v3/projects/bb010a14988747bbaa6e7d8b9cad069b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:11.993201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1008/2031] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:11.999727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce024b-9f11-4750-ab72-36210ab6454f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.001345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce024b-9f11-4750-ab72-36210ab6454f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.001870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce024b-9f11-4750-ab72-36210ab6454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.039679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a1ce024b-9f11-4750-ab72-36210ab6454f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:12.040470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a1ce024b-9f11-4750-ab72-36210ab6454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:12.054729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1024/2032] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:12.057138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3fd42-dc84-4995-919f-89dbb4636c94 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:12.075656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3fd42-dc84-4995-919f-89dbb4636c94 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:12.083864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:12.084946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.085447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.085903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.087175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:12.087740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:12.090853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:12.117699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1009/2033] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:28:12.120068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce024b-9f11-4750-ab72-36210ab6454f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:12.141760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce024b-9f11-4750-ab72-36210ab6454f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:12.151203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:12.152226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.152701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.153215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.154359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:12.158170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:12.347854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1025/2034] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:12 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:12.349489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:12.362998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520f86-67b7-4c1b-9a9a-bd86a972e5ad admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:12.435524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:12.436185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.436334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.436587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.437368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:12.442526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:12.594639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1010/2035] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:12 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:12.624957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:12.637243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070a85f-b1d1-4113-ac6c-2d56817cbd04 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:12.644891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:12.646150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.646698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.647120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.648237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:12.652007 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:12.656599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:12.666689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1026/2036] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:12.671759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:12.683293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70553e49-7fc1-4a72-94c8-36ec35a0a1a6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:12.688589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0c704-d57d-4213-b964-e6e030084d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:12.689175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c704-d57d-4213-b964-e6e030084d51 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.689383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c704-d57d-4213-b964-e6e030084d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.689830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c704-d57d-4213-b964-e6e030084d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.690554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0c704-d57d-4213-b964-e6e030084d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:12.692447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0c704-d57d-4213-b964-e6e030084d51 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:12.704523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1011/2037] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:12.709295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:12.729903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03427b-deb6-4577-8544-17354fc58a0a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:12.738353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:12.738573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.738977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.739366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] PATH_INFO: `/v3/projects/528942f2ec084ebca582ab640d757a1d/users/8556c516568c4a2e95733faa29ed9b54/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.766464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528942f2ec084ebca582ab640d757a1d, user_id=8556c516568c4a2e95733faa29ed9b54, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:12.778974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:12.884704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1027/2038] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:12 2022] PUT /identity/v3/projects/528942f2ec084ebca582ab640d757a1d/users/8556c516568c4a2e95733faa29ed9b54/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:12.897824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce18d-9c19-406d-95e9-cd41831b56fb None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:12.898101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce18d-9c19-406d-95e9-cd41831b56fb None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:12.898373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce18d-9c19-406d-95e9-cd41831b56fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:12.947076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a5bce18d-9c19-406d-95e9-cd41831b56fb None None] MFA Rules not processed for user `8556c516568c4a2e95733faa29ed9b54`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:12.949188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a5bce18d-9c19-406d-95e9-cd41831b56fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:13.082224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1012/2039] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:13.086703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:13.186136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0212b-e668-4dcb-877a-1044dcdd6353 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:13.191908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:13.192576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:13.192895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:13.193172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:13.193804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:13.195708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:13.313551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1028/2040] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:28:13.317827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce18d-9c19-406d-95e9-cd41831b56fb None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:13.330852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce18d-9c19-406d-95e9-cd41831b56fb None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:13.397712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:13.398330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:13.398612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:13.398893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:13.399546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:13.402528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:13.640833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:13.648253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1013/2041] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:13 2022] POST /identity/v3/users => generated 298 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:28:13.653537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:13.664229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a6cc-13e1-4848-b0e6-5447d786705d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:13.669854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:13.670464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:13.670748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:13.671024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:13.671673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:13.673463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:13.686071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1029/2042] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:13.690833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:13.707190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68770-8be5-4588-b207-0d23ef736576 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:13.712769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:13.713435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:13.713798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:13.713980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] PATH_INFO: `/v3/projects/d3f31a427ca84741bdc3ebff9f329bfe/users/37b94f1bb9fa44588fa4e32eafe74a07/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:13.733081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f31a427ca84741bdc3ebff9f329bfe, user_id=37b94f1bb9fa44588fa4e32eafe74a07, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:13.736107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:13.914393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1014/2043] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:13 2022] PUT /identity/v3/projects/d3f31a427ca84741bdc3ebff9f329bfe/users/37b94f1bb9fa44588fa4e32eafe74a07/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:13.919461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:13.932224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dc9bc-0847-4ca2-b6ee-043a9f5ecdcf admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:14.013645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc57d2b-f001-4350-8d05-3abaf7098e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:14.014272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc57d2b-f001-4350-8d05-3abaf7098e93 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:14.014630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc57d2b-f001-4350-8d05-3abaf7098e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:14.014920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc57d2b-f001-4350-8d05-3abaf7098e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:14.015586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc57d2b-f001-4350-8d05-3abaf7098e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:14.017244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc57d2b-f001-4350-8d05-3abaf7098e93 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:14.031861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1030/2044] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:14.036431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:14.049964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbadb8-a064-46f2-9289-7bda45a29c64 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:14.062582 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:14.063271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:14.063551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:14.063832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] PATH_INFO: `/v3/projects/d3f31a427ca84741bdc3ebff9f329bfe/users/37b94f1bb9fa44588fa4e32eafe74a07/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:14.065916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f31a427ca84741bdc3ebff9f329bfe, user_id=37b94f1bb9fa44588fa4e32eafe74a07, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:14.068666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:14.083564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1015/2045] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:14 2022] PUT /identity/v3/projects/d3f31a427ca84741bdc3ebff9f329bfe/users/37b94f1bb9fa44588fa4e32eafe74a07/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:14.103912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:14.104776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:14.105065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:14.151849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] MFA Rules not processed for user `37b94f1bb9fa44588fa4e32eafe74a07`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:14.157931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:14.225509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:14.251723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1031/2046] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:14.264005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:14.266145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:14.358812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706131f7-b96e-4477-93c1-7543a6a66e33 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:14.369473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:14.369904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:14.370187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:14.370462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:14.398479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:14.398479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:14.398479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1016/2047] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:14.510146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:14.511708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:14.529128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f2219-9eeb-4b30-9b2a-984024f683b0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:14.532928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:14.533543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:14.533822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:14.534092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:14.609072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:14.610523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:14.619866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1032/2048] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:15.953614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:16.188090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:17.796934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:18.208414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:18.650147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:18.651911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:18.730352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108f855-5ed9-4960-b09d-0b11c4f8d0a8 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:18.735475 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:18.736009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:18.737179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:18.737179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] PATH_INFO: `/v3/users/43a7beae30f34bc9b9eb6b1b843038d8` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:18.738069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a7beae30f34bc9b9eb6b1b843038d8)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:18.740119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:18.802796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:18.986510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a7beae30f34bc9b9eb6b1b843038d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.027977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:19.039759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db3af-033a-425d-9151-7fcd4b25f094 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:19.045186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:19.045843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:19.046122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:19.046393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] PATH_INFO: `/v3/users/8556c516568c4a2e95733faa29ed9b54` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:19.047507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8556c516568c4a2e95733faa29ed9b54)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:19.049757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:19.076404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a7beae30f34bc9b9eb6b1b843038d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.077151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a7beae30f34bc9b9eb6b1b843038d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.091923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a7beae30f34bc9b9eb6b1b843038d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.106357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3a6685d6-ba6f-46cc-a9b0-49f750cddf00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a7beae30f34bc9b9eb6b1b843038d8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.114050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1017/2049] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:18 2022] DELETE /identity/v3/users/43a7beae30f34bc9b9eb6b1b843038d8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:19.118388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:19.118845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:19.119218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:19.148066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:19.149338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:19.224991 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1018/2050] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:19.235561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:19.237157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:19.301695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6556c-7db6-413a-83fa-1ed3316fe1a3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:19.308251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf017e9f-3a4f-45f4-bbcc-b53284ae1107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:19.308931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf017e9f-3a4f-45f4-bbcc-b53284ae1107 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:19.309224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf017e9f-3a4f-45f4-bbcc-b53284ae1107 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:19.309549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf017e9f-3a4f-45f4-bbcc-b53284ae1107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:19.323572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf017e9f-3a4f-45f4-bbcc-b53284ae1107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:19.325968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8556c516568c4a2e95733faa29ed9b54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.326630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf017e9f-3a4f-45f4-bbcc-b53284ae1107 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:19.327134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8556c516568c4a2e95733faa29ed9b54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.338404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1019/2051] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:28:19.456610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8556c516568c4a2e95733faa29ed9b54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.457583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8556c516568c4a2e95733faa29ed9b54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.466686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8556c516568c4a2e95733faa29ed9b54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:19.495322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1033/2052] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:19 2022] DELETE /identity/v3/users/8556c516568c4a2e95733faa29ed9b54 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:19.502444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:19.502739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:19.508333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:19.527783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:19.529174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:19.669270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1020/2053] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:19.677612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:19.680075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:19.755418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:19.760922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cca36e-64d7-4081-81f8-c9cf378cd67e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:19.765401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236eb0-d436-466a-a182-a47b3d4d9cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:19.766074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236eb0-d436-466a-a182-a47b3d4d9cad service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:19.766355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236eb0-d436-466a-a182-a47b3d4d9cad service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:19.766631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236eb0-d436-466a-a182-a47b3d4d9cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:19.784692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80236eb0-d436-466a-a182-a47b3d4d9cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:19.786224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80236eb0-d436-466a-a182-a47b3d4d9cad service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:19.800255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1034/2054] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:19.969142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:19.970823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:19.984709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208e3c4-51cc-4c9c-b0b7-c209a227bace None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.005281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.005958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.006388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.006650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] PATH_INFO: `/v3/projects/9e9424e2281c4af3948dcb9dcf5bd215` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.008136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9424e2281c4af3948dcb9dcf5bd215)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.010442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:20.144036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9424e2281c4af3948dcb9dcf5bd215', 'request_id': 'req-810863ba-35f2-400c-a11f-8c36978d9b58'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.152334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9424e2281c4af3948dcb9dcf5bd215', 'request_id': 'req-810863ba-35f2-400c-a11f-8c36978d9b58'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.291107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9424e2281c4af3948dcb9dcf5bd215', 'request_id': 'req-810863ba-35f2-400c-a11f-8c36978d9b58'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.304109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] The token cache is being invalidate because project 9e9424e2281c4af3948dcb9dcf5bd215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:20.304390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.305073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.306634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1021/2055] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:19 2022] DELETE /identity/v3/projects/9e9424e2281c4af3948dcb9dcf5bd215 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:20.314144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfca7f-91ff-4d22-846a-eede9bd14237 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.315038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfca7f-91ff-4d22-846a-eede9bd14237 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.315038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfca7f-91ff-4d22-846a-eede9bd14237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.338759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-21bfca7f-91ff-4d22-846a-eede9bd14237 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:20.341409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-21bfca7f-91ff-4d22-846a-eede9bd14237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:20.342422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:20.343768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:20.422906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1035/2056] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:20.423804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810863ba-35f2-400c-a11f-8c36978d9b58 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.429266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.435791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.435791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.435791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] PATH_INFO: `/v3/projects/528942f2ec084ebca582ab640d757a1d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.436129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae4b7-c7f3-4508-8070-b2c696c16611 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.436129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae4b7-c7f3-4508-8070-b2c696c16611 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.436285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528942f2ec084ebca582ab640d757a1d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.436358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae4b7-c7f3-4508-8070-b2c696c16611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.436427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:20.456347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-dfbae4b7-c7f3-4508-8070-b2c696c16611 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:20.457603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-dfbae4b7-c7f3-4508-8070-b2c696c16611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:20.466913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1036/2057] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:20.479854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbae4b7-c7f3-4508-8070-b2c696c16611 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:20.491706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbae4b7-c7f3-4508-8070-b2c696c16611 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.497154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.497766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.498042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.498312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.498965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:20.499266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.501282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:20.519654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1037/2058] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:28:20.525429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:20.541492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b46f6-d241-4212-bf3f-ddc1f228ce41 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.551019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.551895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.552177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.552449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.553163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.555099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:20.662950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528942f2ec084ebca582ab640d757a1d', 'request_id': 'req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.670559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528942f2ec084ebca582ab640d757a1d', 'request_id': 'req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.681705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1038/2059] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:20 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:28:20.686079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:20.761006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab90b4-a109-4cd9-aa88-f66debb0671e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.766035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.766644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.766928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.767196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.767941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.769952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:20.778837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528942f2ec084ebca582ab640d757a1d', 'request_id': 'req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.791892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] The token cache is being invalidate because project 528942f2ec084ebca582ab640d757a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:20.792132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.792851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:20.794441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1022/2060] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:20 2022] DELETE /identity/v3/projects/528942f2ec084ebca582ab640d757a1d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:20.798456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:20.799904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:20.817185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:20.881040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fc4ff-2efd-4b35-b641-0a0712b1f593 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.890074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.891021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.891306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.891585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] PATH_INFO: `/v3/users/37b94f1bb9fa44588fa4e32eafe74a07` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.893601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b94f1bb9fa44588fa4e32eafe74a07)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.895827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:20.912830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1039/2061] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:20 2022] POST /identity/v3/users => generated 282 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:28:20.916966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:20.920380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:20.938092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd6fc4-f7d4-43bd-9552-c9ec0c5e1ff5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.946060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.947275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.947530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.949045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.949742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.951736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:20.964161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1040/2062] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:20.976020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:20.987682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884c422-b2c0-4289-9689-b04cd0272531 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:20.994179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:20.994807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:20.995085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:20.995354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:20.996001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:20.997687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:21.010237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1041/2063] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:21.014888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:21.026632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0bcf5-92fd-4761-8503-97ac033f7ed2 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:21.031558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af512733-e11d-4d14-999f-df1d4d9defe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:21.032223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512733-e11d-4d14-999f-df1d4d9defe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:21.032501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512733-e11d-4d14-999f-df1d4d9defe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:21.032799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512733-e11d-4d14-999f-df1d4d9defe7 admin admin] PATH_INFO: `/v3/projects/aaddfb7ec9bc49579e2a80c997463fea/users/932e294dcb1245d5ab93f5b532f21560/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:21.052154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af512733-e11d-4d14-999f-df1d4d9defe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaddfb7ec9bc49579e2a80c997463fea, user_id=932e294dcb1245d5ab93f5b532f21560, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:21.057528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af512733-e11d-4d14-999f-df1d4d9defe7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:21.136037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b94f1bb9fa44588fa4e32eafe74a07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:21.158661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1042/2064] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:21 2022] PUT /identity/v3/projects/aaddfb7ec9bc49579e2a80c997463fea/users/932e294dcb1245d5ab93f5b532f21560/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:21.170249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aac7d-6a38-49c2-85ce-295f29a5d299 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:21.170535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aac7d-6a38-49c2-85ce-295f29a5d299 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:21.170817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aac7d-6a38-49c2-85ce-295f29a5d299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:21.200381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-640aac7d-6a38-49c2-85ce-295f29a5d299 None None] MFA Rules not processed for user `932e294dcb1245d5ab93f5b532f21560`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:21.201659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-640aac7d-6a38-49c2-85ce-295f29a5d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:21.237598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b94f1bb9fa44588fa4e32eafe74a07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:21.238399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b94f1bb9fa44588fa4e32eafe74a07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:21.260275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b94f1bb9fa44588fa4e32eafe74a07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:21.267229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b94f1bb9fa44588fa4e32eafe74a07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:21.274092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1023/2065] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:20 2022] DELETE /identity/v3/users/37b94f1bb9fa44588fa4e32eafe74a07 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:21.289525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1043/2066] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:21.304980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:21.307160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:21.393390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff00a4-41ae-49ed-9c3b-4fd9ed5ed776 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:21.398374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858187f-a60d-437c-997a-096b5447a5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:21.406157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858187f-a60d-437c-997a-096b5447a5ab service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:21.406157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858187f-a60d-437c-997a-096b5447a5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:21.406157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858187f-a60d-437c-997a-096b5447a5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:21.406157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e858187f-a60d-437c-997a-096b5447a5ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:21.468228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858187f-a60d-437c-997a-096b5447a5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:21.469703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858187f-a60d-437c-997a-096b5447a5ab service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:21.479432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1024/2067] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:21.771068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aac7d-6a38-49c2-85ce-295f29a5d299 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:21.843843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aac7d-6a38-49c2-85ce-295f29a5d299 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:21.902009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:21.902911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:21.903197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:21.903468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] PATH_INFO: `/v3/projects/d3f31a427ca84741bdc3ebff9f329bfe` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:21.904584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f31a427ca84741bdc3ebff9f329bfe)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:21.906544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:22.104140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f31a427ca84741bdc3ebff9f329bfe', 'request_id': 'req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:22.109750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f31a427ca84741bdc3ebff9f329bfe', 'request_id': 'req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:22.115985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f31a427ca84741bdc3ebff9f329bfe', 'request_id': 'req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:22.251905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] The token cache is being invalidate because project d3f31a427ca84741bdc3ebff9f329bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:22.252498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:22.254151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a210b92e-5ee6-4e8e-a434-6143f6ef9e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:22.261194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1044/2068] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:21 2022] DELETE /identity/v3/projects/d3f31a427ca84741bdc3ebff9f329bfe => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:22.264854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a07ab-7e92-4fe2-b481-8c0d8539c1d4 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.265324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a07ab-7e92-4fe2-b481-8c0d8539c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.265543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a07ab-7e92-4fe2-b481-8c0d8539c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:22.288412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-fa3a07ab-7e92-4fe2-b481-8c0d8539c1d4 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:22.289760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fa3a07ab-7e92-4fe2-b481-8c0d8539c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:22.355587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1025/2069] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:22.363544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec6ce-7e61-42e2-8c66-7a751a5381d2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.363832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec6ce-7e61-42e2-8c66-7a751a5381d2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.364199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec6ce-7e61-42e2-8c66-7a751a5381d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:22.376511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:22.391292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1b4ec6ce-7e61-42e2-8c66-7a751a5381d2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:22.392544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1b4ec6ce-7e61-42e2-8c66-7a751a5381d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:22.401773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1045/2070] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:22.406265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a07ab-7e92-4fe2-b481-8c0d8539c1d4 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:22.416972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a07ab-7e92-4fe2-b481-8c0d8539c1d4 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:22.422245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:22.422868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.423145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.423412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:22.424062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:22.424360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:22.426105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:22.442015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1026/2071] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:28:22.446740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec6ce-7e61-42e2-8c66-7a751a5381d2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:22.458126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec6ce-7e61-42e2-8c66-7a751a5381d2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:22.463014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:22.463886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.466256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.466256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:22.466256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:22.467161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:22.688507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1046/2072] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:22 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:22.706010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:22.717092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1191ce5-2086-4dac-a906-e16b55fc718c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:22.780371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:22.781275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.781567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.781842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:22.782490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:22.784422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:22.884108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:22.890416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1027/2073] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:22 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:22.894734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:22.906016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af13f93-001d-4b31-af0c-b18a6466ec98 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:22.910702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:22.911301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.911585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.911898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:22.912546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:22.914193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:22.928844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1047/2074] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:22.930101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:22.941162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa263c-7efb-4c81-9612-6a82337eaa75 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:22.947398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403785a-3654-47db-bc12-f6ea737ae902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:22.948268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403785a-3654-47db-bc12-f6ea737ae902 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.948553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403785a-3654-47db-bc12-f6ea737ae902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.948861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403785a-3654-47db-bc12-f6ea737ae902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:22.949512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403785a-3654-47db-bc12-f6ea737ae902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:22.951112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403785a-3654-47db-bc12-f6ea737ae902 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:22.962827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1028/2075] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:22.967488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:22.977715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675a06f-1c9a-407e-8a40-a4406087e049 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:22.984054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:22.984873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:22.985185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:22.985448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] PATH_INFO: `/v3/projects/1b5a151574b94bc28b8a10b3335c668c/users/47648f58407c4864b0fe5e7a906ecf18/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.001649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5a151574b94bc28b8a10b3335c668c, user_id=47648f58407c4864b0fe5e7a906ecf18, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.004335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.092268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1048/2076] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:22 2022] PUT /identity/v3/projects/1b5a151574b94bc28b8a10b3335c668c/users/47648f58407c4864b0fe5e7a906ecf18/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:23.104597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d13d85-87c6-4af0-b305-83b7058ed562 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.104950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d13d85-87c6-4af0-b305-83b7058ed562 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.105296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d13d85-87c6-4af0-b305-83b7058ed562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.139501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-31d13d85-87c6-4af0-b305-83b7058ed562 None None] MFA Rules not processed for user `47648f58407c4864b0fe5e7a906ecf18`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:23.139501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-31d13d85-87c6-4af0-b305-83b7058ed562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:23.219015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1029/2077] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:23.223647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:23.292534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b49978-768a-4c41-92cf-beac1f6e595c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:23.297553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:23.298540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.298540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.298714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.299348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.301263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.406256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1049/2078] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:23 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:28:23.407863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d13d85-87c6-4af0-b305-83b7058ed562 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:23.421861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d13d85-87c6-4af0-b305-83b7058ed562 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:23.457110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:23.459030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:23.492786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:23.497032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:23.497487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.499723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.499723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.499723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.501245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.527362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bc4ff-6866-4514-a747-b95ea8d2e61e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:23.532196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:23.532911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.533193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.533469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.535400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:23.607561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.609162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.619958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1050/2079] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:28:23.660224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1030/2080] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:23 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:23.664551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:23.675520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fdcbf-d0c8-4696-b16f-1313edae88c3 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:23.680397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:23.681039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.681319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.681591 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.682392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.684085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.695567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1051/2081] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:23.715774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:23.727337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6ee0-4a63-4faf-87d8-4145e8c24719 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:23.733651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:23.734318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.734598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.734879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] PATH_INFO: `/v3/projects/982bdd64991c4357b0a4d192c09c8150/users/a0164b1e9ec3470389ee8da975e81d12/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.752445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982bdd64991c4357b0a4d192c09c8150, user_id=a0164b1e9ec3470389ee8da975e81d12, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.755246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.846867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1031/2082] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:23 2022] PUT /identity/v3/projects/982bdd64991c4357b0a4d192c09c8150/users/a0164b1e9ec3470389ee8da975e81d12/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:23.855527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:23.866628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c102d-2595-408d-b4eb-84182b74e1f5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:23.928988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1f326-d1fd-4f92-b1ab-b7be91072992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:23.929633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1f326-d1fd-4f92-b1ab-b7be91072992 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.929781 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1f326-d1fd-4f92-b1ab-b7be91072992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.930058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1f326-d1fd-4f92-b1ab-b7be91072992 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.930701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1f326-d1fd-4f92-b1ab-b7be91072992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.933282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1f326-d1fd-4f92-b1ab-b7be91072992 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.943405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1052/2083] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:23.948390 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:23.959318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce2da-6a46-43f0-bcfa-0c3a9d0689f6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:23.964167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:23.964868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.965536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.965816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] PATH_INFO: `/v3/projects/982bdd64991c4357b0a4d192c09c8150/users/a0164b1e9ec3470389ee8da975e81d12/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:23.968041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=982bdd64991c4357b0a4d192c09c8150, user_id=a0164b1e9ec3470389ee8da975e81d12, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:23.970723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:23.982110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1032/2084] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:23 2022] PUT /identity/v3/projects/982bdd64991c4357b0a4d192c09c8150/users/a0164b1e9ec3470389ee8da975e81d12/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:23.992520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec7187-50be-4465-8efc-e6638151f762 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:23.992847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec7187-50be-4465-8efc-e6638151f762 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:23.993129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec7187-50be-4465-8efc-e6638151f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:24.023555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-81ec7187-50be-4465-8efc-e6638151f762 None None] MFA Rules not processed for user `a0164b1e9ec3470389ee8da975e81d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:24.024812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-81ec7187-50be-4465-8efc-e6638151f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:24.093804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1053/2085] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:24.105840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:24.116849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:24.169092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5ee1-b6bb-4d44-9e88-2a5565036e0b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:24.172978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:24.173592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:24.173872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:24.174209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:24.184665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:24.186065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:24.196162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1033/2086] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:24.251035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:24.376677 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec7187-50be-4465-8efc-e6638151f762 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:24.388236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec7187-50be-4465-8efc-e6638151f762 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:24.392458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b4c85-a8cb-415c-8614-2f16f1deffdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:24.393260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4c85-a8cb-415c-8614-2f16f1deffdb service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:24.393422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4c85-a8cb-415c-8614-2f16f1deffdb service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:24.393706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4c85-a8cb-415c-8614-2f16f1deffdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:24.456073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b4c85-a8cb-415c-8614-2f16f1deffdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:24.457700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b4c85-a8cb-415c-8614-2f16f1deffdb service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:24.467791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1054/2087] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:25.043368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:25.300829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:25.381078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718174a-7de4-4348-95d6-3a59ebe36cf4 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:25.386900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:25.387568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:25.387865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:25.388126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] PATH_INFO: `/v3/users/47648f58407c4864b0fe5e7a906ecf18` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:25.398901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47648f58407c4864b0fe5e7a906ecf18)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:25.398901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:25.643222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47648f58407c4864b0fe5e7a906ecf18'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:25.761373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47648f58407c4864b0fe5e7a906ecf18'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:25.762382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47648f58407c4864b0fe5e7a906ecf18'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:25.788701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47648f58407c4864b0fe5e7a906ecf18'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:25.801378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47648f58407c4864b0fe5e7a906ecf18'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:25.810847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1034/2088] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:25 2022] DELETE /identity/v3/users/47648f58407c4864b0fe5e7a906ecf18 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:25.817069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:25.817592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:25.818289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:25.848094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:25.850121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:25.948414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1055/2089] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:25.957367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:25.959034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:26.062620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69a156-6c6e-405c-bd92-687f6f40d3b2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:26.067024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:26.067640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:26.068115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:26.068388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:26.080713 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:26.082210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:26.094655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1035/2090] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:26.391683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:26.556263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:26.558686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:26.572054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d13b-f941-4e30-986f-6671e107bf67 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:26.585753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:26.585753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:26.585753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:26.585753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] PATH_INFO: `/v3/projects/1b5a151574b94bc28b8a10b3335c668c` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:26.586377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5a151574b94bc28b8a10b3335c668c)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:26.586377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:26.607292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:26.728202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5a151574b94bc28b8a10b3335c668c', 'request_id': 'req-48083d58-e155-49e1-88b4-0a43bee169fb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:26.735584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5a151574b94bc28b8a10b3335c668c', 'request_id': 'req-48083d58-e155-49e1-88b4-0a43bee169fb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:26.742646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5a151574b94bc28b8a10b3335c668c', 'request_id': 'req-48083d58-e155-49e1-88b4-0a43bee169fb'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:26.836483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] The token cache is being invalidate because project 1b5a151574b94bc28b8a10b3335c668c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:26.837164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:26.837427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:26.839525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1056/2091] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:26 2022] DELETE /identity/v3/projects/1b5a151574b94bc28b8a10b3335c668c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:26.843787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:26.854329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a35cc-88ff-4139-89a5-c5f7d6a3e676 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:26.917480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:26.918079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:26.918356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:26.918634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] PATH_INFO: `/v3/users/a0164b1e9ec3470389ee8da975e81d12` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:26.919799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0164b1e9ec3470389ee8da975e81d12)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:26.921776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:27.157285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0164b1e9ec3470389ee8da975e81d12'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:27.238739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0164b1e9ec3470389ee8da975e81d12'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:27.239444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0164b1e9ec3470389ee8da975e81d12'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:27.253092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0164b1e9ec3470389ee8da975e81d12'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:27.261002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3eab4958-0157-4a92-bdc7-4a07bd09bbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0164b1e9ec3470389ee8da975e81d12'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:27.268108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1036/2092] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:26 2022] DELETE /identity/v3/users/a0164b1e9ec3470389ee8da975e81d12 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:27.992454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:27.993938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:28.028383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083d58-e155-49e1-88b4-0a43bee169fb admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:28.093112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:28.093751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.094034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.094309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] PATH_INFO: `/v3/projects/982bdd64991c4357b0a4d192c09c8150` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.095432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=982bdd64991c4357b0a4d192c09c8150)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:28.097395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:28.253331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982bdd64991c4357b0a4d192c09c8150', 'request_id': 'req-70777b73-d344-45a5-a974-53263123ed8d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:28.258992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982bdd64991c4357b0a4d192c09c8150', 'request_id': 'req-70777b73-d344-45a5-a974-53263123ed8d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:28.266634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982bdd64991c4357b0a4d192c09c8150', 'request_id': 'req-70777b73-d344-45a5-a974-53263123ed8d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:28.313526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:28.344585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] The token cache is being invalidate because project 982bdd64991c4357b0a4d192c09c8150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:28.345079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:28.346017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-70777b73-d344-45a5-a974-53263123ed8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:28.348141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1057/2093] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:27 2022] DELETE /identity/v3/projects/982bdd64991c4357b0a4d192c09c8150 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:28.354719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936b648-26c3-4309-a074-9d72663e828d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.356546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936b648-26c3-4309-a074-9d72663e828d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.356546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936b648-26c3-4309-a074-9d72663e828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.390472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6936b648-26c3-4309-a074-9d72663e828d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:28.392343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6936b648-26c3-4309-a074-9d72663e828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:28.412021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:28.464272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1037/2094] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:28.473461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595c0a7-08df-4dc5-8e29-9206c7582bb5 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.473753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595c0a7-08df-4dc5-8e29-9206c7582bb5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.474056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595c0a7-08df-4dc5-8e29-9206c7582bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.499921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e595c0a7-08df-4dc5-8e29-9206c7582bb5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:28.501439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e595c0a7-08df-4dc5-8e29-9206c7582bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:28.510935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1058/2095] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:28.516937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936b648-26c3-4309-a074-9d72663e828d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:28.529487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936b648-26c3-4309-a074-9d72663e828d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:28.534477 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:28.535115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.535469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.535737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.536405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:28.536709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:28.538391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:28.552232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1038/2096] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:28:28.557216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595c0a7-08df-4dc5-8e29-9206c7582bb5 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:28.567200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595c0a7-08df-4dc5-8e29-9206c7582bb5 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:28.572417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:28.573183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.573464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.573734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.574359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:28.577928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:28.690080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1059/2097] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:28 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:28.694218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:28.704837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279383cb-6a72-412f-baad-be126f7cf6fc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:28.770861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:28.771484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.771764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.772039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.772701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:28.774726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:28.901081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1039/2098] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:28 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:28.905149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:28.915544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada27a6a-e72d-4ca9-803c-764d5132517f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:28.921674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:28.922278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.922565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.922849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.923498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:28.925162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:28.936658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1060/2099] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:28.941026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:28.953097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96138d-5e3c-4b79-bc1c-4e558f6dc42f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:28.958920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b2054-2d69-459d-a03d-a2c93c2017e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:28.959401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b2054-2d69-459d-a03d-a2c93c2017e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:28.959749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b2054-2d69-459d-a03d-a2c93c2017e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:28.960016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b2054-2d69-459d-a03d-a2c93c2017e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:28.960666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b2054-2d69-459d-a03d-a2c93c2017e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:28.962318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b2054-2d69-459d-a03d-a2c93c2017e6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:28.985201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1040/2100] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:28.985383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:28.999123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7d96a-0a78-4638-af90-89e89044384c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:29.004598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:29.005792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:29.006139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:29.006417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] PATH_INFO: `/v3/projects/3d26f808ada649d696efa09dfae1934d/users/ac299f6f621546d49f85698322c92ad5/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:29.022283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d26f808ada649d696efa09dfae1934d, user_id=ac299f6f621546d49f85698322c92ad5, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:29.025031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:29.107739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1061/2101] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:28 2022] PUT /identity/v3/projects/3d26f808ada649d696efa09dfae1934d/users/ac299f6f621546d49f85698322c92ad5/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:29.120051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24182223-ae86-4642-9282-21249b5c0eb9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:29.120426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24182223-ae86-4642-9282-21249b5c0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:29.121070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24182223-ae86-4642-9282-21249b5c0eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:29.155555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-24182223-ae86-4642-9282-21249b5c0eb9 None None] MFA Rules not processed for user `ac299f6f621546d49f85698322c92ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:29.156990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-24182223-ae86-4642-9282-21249b5c0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:29.240645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1041/2102] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:29.248750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:29.250783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:29.317486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeb5a4-2d91-42d7-b5e2-060006cde556 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:29.321908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef054-44b2-4317-b822-2ecf70e44538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:29.322172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef054-44b2-4317-b822-2ecf70e44538 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:29.322510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef054-44b2-4317-b822-2ecf70e44538 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:29.322784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef054-44b2-4317-b822-2ecf70e44538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:29.333940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef054-44b2-4317-b822-2ecf70e44538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:29.336082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef054-44b2-4317-b822-2ecf70e44538 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:29.345767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1062/2103] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:29.433984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:29.685570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:29.956965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:30.108558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:30.907457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:31.018355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:31.723058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:31.873834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:32.387864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:32.437419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:33.107702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:33.313710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:33.688284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:33.711990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:33.845200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:33.873462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:34.444863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:34.896704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:35.113848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:35.267849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:35.508381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:35.662413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:35.749368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:36.122762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:37.176026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:40.402023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24182223-ae86-4642-9282-21249b5c0eb9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:40.475831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24182223-ae86-4642-9282-21249b5c0eb9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:40.480226 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:40.480904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.481183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.481456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] PATH_INFO: `/v3/users/ac299f6f621546d49f85698322c92ad5` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.483401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac299f6f621546d49f85698322c92ad5)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:40.485606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:40.780455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:40.806586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac299f6f621546d49f85698322c92ad5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.896771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac299f6f621546d49f85698322c92ad5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.897493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac299f6f621546d49f85698322c92ad5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.912352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac299f6f621546d49f85698322c92ad5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.919575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac299f6f621546d49f85698322c92ad5'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.926640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1042/2104] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:40 2022] DELETE /identity/v3/users/ac299f6f621546d49f85698322c92ad5 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:40.931225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.931737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.931832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.945604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:40.953641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:40.955120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:41.035427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1063/2105] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:41.045884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:41.047406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:41.109631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e580-d5a2-4bd7-9cd9-64caaeed875d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:41.113458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314176a-85c7-4404-b8ad-1aa5a8c73dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:41.114065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314176a-85c7-4404-b8ad-1aa5a8c73dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:41.114346 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314176a-85c7-4404-b8ad-1aa5a8c73dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:41.114664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314176a-85c7-4404-b8ad-1aa5a8c73dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:41.125176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314176a-85c7-4404-b8ad-1aa5a8c73dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:41.126629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314176a-85c7-4404-b8ad-1aa5a8c73dc6 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:41.136510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1043/2106] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:28:41.690555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:41.692051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:41.704321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458837a-89ca-4c75-885a-8affb1502a9b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:41.709473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:41.710126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:41.710400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:41.710666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] PATH_INFO: `/v3/projects/3d26f808ada649d696efa09dfae1934d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:41.711874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d26f808ada649d696efa09dfae1934d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:41.713822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:41.869256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d26f808ada649d696efa09dfae1934d', 'request_id': 'req-fef71f51-c399-4deb-8884-b2d5a527e508'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:41.877052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d26f808ada649d696efa09dfae1934d', 'request_id': 'req-fef71f51-c399-4deb-8884-b2d5a527e508'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:41.885717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d26f808ada649d696efa09dfae1934d', 'request_id': 'req-fef71f51-c399-4deb-8884-b2d5a527e508'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:41.999337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] The token cache is being invalidate because project 3d26f808ada649d696efa09dfae1934d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:41.999977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:42.004029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-fef71f51-c399-4deb-8884-b2d5a527e508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:42.004029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1064/2107] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:41 2022] DELETE /identity/v3/projects/3d26f808ada649d696efa09dfae1934d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:42.007256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55d094-2bb6-4d33-abcf-b5143d3ff7be None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.007738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55d094-2bb6-4d33-abcf-b5143d3ff7be None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.007847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55d094-2bb6-4d33-abcf-b5143d3ff7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.029596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4e55d094-2bb6-4d33-abcf-b5143d3ff7be None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:42.031300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4e55d094-2bb6-4d33-abcf-b5143d3ff7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:42.130381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1044/2108] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:42.131870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875c96-f3a0-4369-8f61-b7c9c7899398 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.132408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875c96-f3a0-4369-8f61-b7c9c7899398 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.132640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875c96-f3a0-4369-8f61-b7c9c7899398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.157875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-bf875c96-f3a0-4369-8f61-b7c9c7899398 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:42.159150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-bf875c96-f3a0-4369-8f61-b7c9c7899398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:42.171021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1065/2109] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:42.176136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55d094-2bb6-4d33-abcf-b5143d3ff7be None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:42.196127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55d094-2bb6-4d33-abcf-b5143d3ff7be None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:42.202117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:42.202879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.203158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.203435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.204231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:42.204536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:42.206193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:42.222142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1045/2110] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:28:42.226868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875c96-f3a0-4369-8f61-b7c9c7899398 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:42.237674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875c96-f3a0-4369-8f61-b7c9c7899398 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:42.250656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:42.251385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.253054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.253054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.253054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:42.254590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:42.412848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1066/2111] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:42 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:42.417683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:42.429028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52078d0-5e1c-44c0-a6ac-05bc36dd722d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:42.478322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:42.496295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:42.497027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.497392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.498551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.499912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:42.501881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:42.772232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1046/2112] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:42 2022] POST /identity/v3/users => generated 287 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:42.776614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:42.788832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc87a96-0824-45df-857d-beb2b36d784a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:42.793618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:42.794223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.794584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.794894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.795543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:42.797207 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:42.809304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1067/2113] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:42.819244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:42.830391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ad20-9589-4fe2-907d-1b8c09fd35e8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:42.835590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b2fd9-6daf-4c9c-9cb8-ae09791ded93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:42.836206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b2fd9-6daf-4c9c-9cb8-ae09791ded93 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.836472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b2fd9-6daf-4c9c-9cb8-ae09791ded93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.836764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b2fd9-6daf-4c9c-9cb8-ae09791ded93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.837519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b2fd9-6daf-4c9c-9cb8-ae09791ded93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:42.839152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b2fd9-6daf-4c9c-9cb8-ae09791ded93 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:42.851302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1047/2114] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:42.859881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:42.870579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ce8f-6c4f-41ad-bd7a-d831d9eb94ab admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:42.876568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:42.877272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:42.877559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:42.877878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] PATH_INFO: `/v3/projects/849ce5f684af4860aa755c7e8e15853e/users/42f7ce5c3b77442a9e6a3a7e12b1b306/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:42.894856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] RBAC: Authorizing `identity:create_grant(project_id=849ce5f684af4860aa755c7e8e15853e, user_id=42f7ce5c3b77442a9e6a3a7e12b1b306, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:42.897833 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:42.991508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1068/2115] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:42 2022] PUT /identity/v3/projects/849ce5f684af4860aa755c7e8e15853e/users/42f7ce5c3b77442a9e6a3a7e12b1b306/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:43.003174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d582-a371-4658-9bb6-c432a96de193 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:43.003553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d582-a371-4658-9bb6-c432a96de193 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:43.003895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d582-a371-4658-9bb6-c432a96de193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:43.039008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-51c4d582-a371-4658-9bb6-c432a96de193 None None] MFA Rules not processed for user `42f7ce5c3b77442a9e6a3a7e12b1b306`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:43.039008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-51c4d582-a371-4658-9bb6-c432a96de193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:43.103983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1048/2116] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:43.118966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:43.121078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:43.156412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:43.189368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d803bab-cba8-4359-9889-40160c72406a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:43.193156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bde5e-4baa-45b4-967b-8a29140dfec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:43.193762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bde5e-4baa-45b4-967b-8a29140dfec5 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:43.194042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bde5e-4baa-45b4-967b-8a29140dfec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:43.194323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bde5e-4baa-45b4-967b-8a29140dfec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:43.207294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0bde5e-4baa-45b4-967b-8a29140dfec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:43.207294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0bde5e-4baa-45b4-967b-8a29140dfec5 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:43.217500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1069/2117] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:28:53.127956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:53.278664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=14 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:59.319572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606cbf7-0674-47a5-984d-de3b8222310d None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:59.320694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606cbf7-0674-47a5-984d-de3b8222310d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:59.320982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606cbf7-0674-47a5-984d-de3b8222310d None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:59.323302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1049/2118] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:28:59.368431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:59.368431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:59.368431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:59.387221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:59.389872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:59.485721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1070/2119] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:28:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:59.503511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606cbf7-0674-47a5-984d-de3b8222310d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:59.508483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1606cbf7-0674-47a5-984d-de3b8222310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:59.533154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606cbf7-0674-47a5-984d-de3b8222310d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:59.539330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:59.540297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:59.540833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:59.541127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:59.550986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:59.553860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:59.565868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1050/2120] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:00.301550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:00.303234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:00.384007 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493851fc-387d-4ddf-9f60-357316cbca14 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:00.390190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:00.391027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:00.391807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:00.391807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] PATH_INFO: `/v3/users/790029c00d264de49d1d423434fad0a7` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:00.394401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790029c00d264de49d1d423434fad0a7)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:00.394721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:00.670603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790029c00d264de49d1d423434fad0a7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:00.671305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790029c00d264de49d1d423434fad0a7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:00.792506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790029c00d264de49d1d423434fad0a7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:00.793141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790029c00d264de49d1d423434fad0a7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:00.801358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790029c00d264de49d1d423434fad0a7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:00.820263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1071/2121] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:00 2022] DELETE /identity/v3/users/790029c00d264de49d1d423434fad0a7 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:01.098369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:01.125855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d4fcb-e747-404c-8439-3dfa28d40123 service placement] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:01.218071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:01.219247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:01.219889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:01.220384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] PATH_INFO: `/v3/projects/733037ac0cab442b9bf7d773fc2ec65c` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:01.223022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733037ac0cab442b9bf7d773fc2ec65c)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:01.227116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:01.379109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733037ac0cab442b9bf7d773fc2ec65c', 'request_id': 'req-3d439985-a83e-4874-a6cb-43c7058b86b4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:01.386935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733037ac0cab442b9bf7d773fc2ec65c', 'request_id': 'req-3d439985-a83e-4874-a6cb-43c7058b86b4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:01.507414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733037ac0cab442b9bf7d773fc2ec65c', 'request_id': 'req-3d439985-a83e-4874-a6cb-43c7058b86b4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:01.533604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] The token cache is being invalidate because project 733037ac0cab442b9bf7d773fc2ec65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:01.534024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:01.534823 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:01.536655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1051/2122] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:01 2022] DELETE /identity/v3/projects/733037ac0cab442b9bf7d773fc2ec65c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:01.541280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:01.543524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:01.551509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:01.553301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:01.569415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e16e-b1dd-44ff-aabe-8a328ca2e014 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:01.592016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:01.643096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439985-a83e-4874-a6cb-43c7058b86b4 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:01.649804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:01.653906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:01.654189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:01.654468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] PATH_INFO: `/v3/users/42f7ce5c3b77442a9e6a3a7e12b1b306` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:01.655847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f7ce5c3b77442a9e6a3a7e12b1b306)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:01.659655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:01.703649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:01.704554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:01.705232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:01.705704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] PATH_INFO: `/v3/users/588c3224c0db4972b78957b483a873c9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:01.708877 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588c3224c0db4972b78957b483a873c9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:01.714666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:01.720976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:01.981510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588c3224c0db4972b78957b483a873c9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:01.981730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f7ce5c3b77442a9e6a3a7e12b1b306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:01.982425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588c3224c0db4972b78957b483a873c9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.067019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f7ce5c3b77442a9e6a3a7e12b1b306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.067956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f7ce5c3b77442a9e6a3a7e12b1b306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.090006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f7ce5c3b77442a9e6a3a7e12b1b306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.099807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8ccbc37a-c78a-44e8-8964-724e0a6b252e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f7ce5c3b77442a9e6a3a7e12b1b306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.106635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1052/2123] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:01 2022] DELETE /identity/v3/users/42f7ce5c3b77442a9e6a3a7e12b1b306 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:02.112206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:02.112703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:02.113218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:02.135238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588c3224c0db4972b78957b483a873c9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.136095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588c3224c0db4972b78957b483a873c9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.139222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:02.140500 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:02.147381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588c3224c0db4972b78957b483a873c9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.176387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1072/2124] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:01 2022] DELETE /identity/v3/users/588c3224c0db4972b78957b483a873c9 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:02.224172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1053/2125] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:02.239241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:02.239241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:02.319764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5d6a-852a-43ef-bfdd-ad6af3f7fa14 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:02.324411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999135c2-b920-4ea0-b702-82488c6f3a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:02.325905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999135c2-b920-4ea0-b702-82488c6f3a99 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:02.326407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999135c2-b920-4ea0-b702-82488c6f3a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:02.326719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999135c2-b920-4ea0-b702-82488c6f3a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:02.409216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:02.436276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999135c2-b920-4ea0-b702-82488c6f3a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:02.437977 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999135c2-b920-4ea0-b702-82488c6f3a99 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:02.449151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1073/2126] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:02.523444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:02.528156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:02.560922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59c4e-60fe-4df1-b021-07fd95cfa96d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:02.595702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:02.599012 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:02.599297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:02.599734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] PATH_INFO: `/v3/projects/a2334b8db8264390827f492d001a486c` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:02.602071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2334b8db8264390827f492d001a486c)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:02.609204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:02.760086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2334b8db8264390827f492d001a486c', 'request_id': 'req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.775857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2334b8db8264390827f492d001a486c', 'request_id': 'req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.976335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2334b8db8264390827f492d001a486c', 'request_id': 'req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.992687 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] The token cache is being invalidate because project a2334b8db8264390827f492d001a486c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:02.993020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.993708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-08a21999-2e9e-441e-8c1d-f37ef16fa8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:02.995347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1054/2127] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:02 2022] DELETE /identity/v3/projects/a2334b8db8264390827f492d001a486c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:03.002074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c0551-0a43-41c5-a9f4-7511cca3d88f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.002710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c0551-0a43-41c5-a9f4-7511cca3d88f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.002710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c0551-0a43-41c5-a9f4-7511cca3d88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.031939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-929c0551-0a43-41c5-a9f4-7511cca3d88f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:03.034103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-929c0551-0a43-41c5-a9f4-7511cca3d88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:03.151909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1074/2128] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:03.167389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ec1b-2910-415f-aed8-97403c0cd1a2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.167977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ec1b-2910-415f-aed8-97403c0cd1a2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.168315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ec1b-2910-415f-aed8-97403c0cd1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.200004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9709ec1b-2910-415f-aed8-97403c0cd1a2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:03.201554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9709ec1b-2910-415f-aed8-97403c0cd1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:03.214106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1055/2129] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:03.221790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c0551-0a43-41c5-a9f4-7511cca3d88f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:03.238803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c0551-0a43-41c5-a9f4-7511cca3d88f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:03.249904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:03.251092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.251552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.251993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.255854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:29:03.255854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:03.257136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:03.282624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1075/2130] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:29:03.290661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ec1b-2910-415f-aed8-97403c0cd1a2 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:03.320848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ec1b-2910-415f-aed8-97403c0cd1a2 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:03.331330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:03.332367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.332801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.333211 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.334251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:03.337681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:03.361406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:03.415468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:03.420482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:03.452205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b946-666f-4af5-858f-e3e5cf928216 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:03.457724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:03.458411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.458694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.458971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] PATH_INFO: `/v3/projects/849ce5f684af4860aa755c7e8e15853e` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.460285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849ce5f684af4860aa755c7e8e15853e)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:03.462346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:03.577559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1056/2131] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:29:03 2022] POST /identity/v3/projects => generated 385 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:03.594556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:03.712764 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e175c-dde3-4f6f-a416-8c122bbdc38f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:03.733600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849ce5f684af4860aa755c7e8e15853e', 'request_id': 'req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:03.743940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849ce5f684af4860aa755c7e8e15853e', 'request_id': 'req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:03.754627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849ce5f684af4860aa755c7e8e15853e', 'request_id': 'req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:03.808506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:03.811548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.812208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.812845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.814188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:03.818715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:03.889453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] The token cache is being invalidate because project 849ce5f684af4860aa755c7e8e15853e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:03.889904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:03.891757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-96f5b33e-8b0e-44ac-9780-f7ccc524ee87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:03.894643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1076/2132] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:03 2022] DELETE /identity/v3/projects/849ce5f684af4860aa755c7e8e15853e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:03.900694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64293fb-eb00-4be1-9aaa-2690a2ada16b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.901165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64293fb-eb00-4be1-9aaa-2690a2ada16b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.901547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64293fb-eb00-4be1-9aaa-2690a2ada16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.922626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1057/2133] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:29:03 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:03.927430 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:03.928697 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a64293fb-eb00-4be1-9aaa-2690a2ada16b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:03.929588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:03.931073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a64293fb-eb00-4be1-9aaa-2690a2ada16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:03.943017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1077/2134] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:03.948603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6847bd-412f-4447-9344-fc8f8df17321 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:03.951700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f272d-ea25-4e30-b181-9dcdb40d3db1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.951987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f272d-ea25-4e30-b181-9dcdb40d3db1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.952264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f272d-ea25-4e30-b181-9dcdb40d3db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.958807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:03.959436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:03.959708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:03.959989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:03.960918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:03.962850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:03.982288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0b1f272d-ea25-4e30-b181-9dcdb40d3db1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:03.983786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0b1f272d-ea25-4e30-b181-9dcdb40d3db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:03.993399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1058/2135] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:29:03.998234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1078/2136] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:04.001182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.009355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f272d-ea25-4e30-b181-9dcdb40d3db1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.021079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae73bb4-15c0-4a43-ad24-298ed2747718 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.027112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f272d-ea25-4e30-b181-9dcdb40d3db1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.029835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.030593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.030883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.031191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.031996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.034054 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.034240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.034993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.035469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.036294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.037635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:29:04.038124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.040581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.061329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1059/2137] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:29:04.064521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1079/2138] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:29:04.064766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.069682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.092379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702860b6-a1af-45c1-84e7-5536bfd52707 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.095809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b65bfd-98d5-46cf-9c62-728b808d44ee admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.098998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.100114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.100916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.102113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.103909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.108800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.113805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5b6f6-849b-4cc5-b76f-fa924b7368ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.113805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b6f6-849b-4cc5-b76f-fa924b7368ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.113805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b6f6-849b-4cc5-b76f-fa924b7368ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.113805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b6f6-849b-4cc5-b76f-fa924b7368ab admin admin] PATH_INFO: `/v3/projects/6da360961a664787ae7326b2158adfaf/users/1b3ac20aa386439fb54d169a3f27aa44/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.138656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5b6f6-849b-4cc5-b76f-fa924b7368ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da360961a664787ae7326b2158adfaf, user_id=1b3ac20aa386439fb54d169a3f27aa44, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.141773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5b6f6-849b-4cc5-b76f-fa924b7368ab admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.261365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1080/2139] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:29:04 2022] POST /identity/v3/projects => generated 397 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:04.265898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.285758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1060/2140] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:04 2022] PUT /identity/v3/projects/6da360961a664787ae7326b2158adfaf/users/1b3ac20aa386439fb54d169a3f27aa44/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:04.302466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:04.306002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d042f-63f1-400d-9afb-86a2f29d375e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.306446 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d042f-63f1-400d-9afb-86a2f29d375e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.306908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d042f-63f1-400d-9afb-86a2f29d375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.354724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bd9d042f-63f1-400d-9afb-86a2f29d375e None None] MFA Rules not processed for user `1b3ac20aa386439fb54d169a3f27aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:04.357730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bd9d042f-63f1-400d-9afb-86a2f29d375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:04.391507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9a94-32e3-46d3-826e-2adad8969b56 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.413552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:04.494916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1061/2141] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:04.508090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d042f-63f1-400d-9afb-86a2f29d375e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.509249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.510419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.510902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.511364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.513120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.516894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.529925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d042f-63f1-400d-9afb-86a2f29d375e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.536668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.537245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.537569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.537843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.538640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.540625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.718489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1081/2142] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:29:04 2022] POST /identity/v3/users => generated 299 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:29:04.725345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.740773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1062/2143] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:29:04 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:04.741006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73442-32f4-482d-8db9-4ba683b7ecdd admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.744585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.830725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.831222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.831502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.831784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.832794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.834755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.841413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2edaf-e4b3-43d9-a93b-5ede75e8abe2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.866216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.867191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.867633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.868121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.869394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.872482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1082/2144] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:04.876441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.877011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.894100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb587-00a3-46f4-a556-3891cc33e712 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.902317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.903144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.903440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.903693 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.904399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.906075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:04.923234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1083/2145] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:04.927965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.942362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc131-b4c7-454b-afa9-e0d983f611a2 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.954047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af9eff-acaa-42cb-94e1-c4ee1e689892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.954743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af9eff-acaa-42cb-94e1-c4ee1e689892 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.955027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af9eff-acaa-42cb-94e1-c4ee1e689892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.955306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af9eff-acaa-42cb-94e1-c4ee1e689892 admin admin] PATH_INFO: `/v3/projects/85f56018ff2b43cf8fb4ec8f653fa8c8/users/209495cd85c44ba8bacebace0b7b703b/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.974291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af9eff-acaa-42cb-94e1-c4ee1e689892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f56018ff2b43cf8fb4ec8f653fa8c8, user_id=209495cd85c44ba8bacebace0b7b703b, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:04.977110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af9eff-acaa-42cb-94e1-c4ee1e689892 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:05.139038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1063/2146] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:29:04 2022] POST /identity/v3/users => generated 298 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:05.140219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:05.151575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c538-ece5-447e-8472-c3189cc96765 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:05.160966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:05.160966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:05.160966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:05.160966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:05.181137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:05.181137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:05.181137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1064/2147] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:29:05.181645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:05.196510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42905f92-cb89-456a-8e04-3466b09d6f16 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:05.202727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:05.203643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:05.204110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:05.204481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] PATH_INFO: `/v3/projects/7b3f5bdb9d0745e2ab2e78dc67cd5931/users/b5b85ef3161940908b2b91e2c5fdfddf/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:05.208090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1084/2148] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:04 2022] PUT /identity/v3/projects/85f56018ff2b43cf8fb4ec8f653fa8c8/users/209495cd85c44ba8bacebace0b7b703b/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:05.220315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:05.221351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:05.221649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:05.224544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f5bdb9d0745e2ab2e78dc67cd5931, user_id=b5b85ef3161940908b2b91e2c5fdfddf, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:05.227385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:05.253813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] MFA Rules not processed for user `209495cd85c44ba8bacebace0b7b703b`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:05.255042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:05.326320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1085/2149] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:05.338996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:05.340590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:05.408327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d62b8-154d-4dcb-b135-2ac9244b9169 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:05.412864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:05.505172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:05.505172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:05.505172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:05.505172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:05.505172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:05.505172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1086/2150] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:29:05.811148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1065/2151] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:05 2022] PUT /identity/v3/projects/7b3f5bdb9d0745e2ab2e78dc67cd5931/users/b5b85ef3161940908b2b91e2c5fdfddf/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:05.822309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:05.825100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:05.929679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b04758-e189-4955-96cf-148bcd20e715 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:06.026471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5d54-b791-48ca-84ed-5bb64b5ab755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:06.027189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5d54-b791-48ca-84ed-5bb64b5ab755 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:06.027605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5d54-b791-48ca-84ed-5bb64b5ab755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:06.028505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5d54-b791-48ca-84ed-5bb64b5ab755 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:06.029531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5d54-b791-48ca-84ed-5bb64b5ab755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:06.031400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5d54-b791-48ca-84ed-5bb64b5ab755 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:06.044070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1087/2152] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:06.051351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:06.069364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e77e-04aa-4eaf-bbb1-9877029e00e6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:06.082486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:06.084335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:06.084335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:06.084335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] PATH_INFO: `/v3/projects/7b3f5bdb9d0745e2ab2e78dc67cd5931/users/b5b85ef3161940908b2b91e2c5fdfddf/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:06.086766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f5bdb9d0745e2ab2e78dc67cd5931, user_id=b5b85ef3161940908b2b91e2c5fdfddf, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:06.090891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:06.117033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1066/2153] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:06 2022] PUT /identity/v3/projects/7b3f5bdb9d0745e2ab2e78dc67cd5931/users/b5b85ef3161940908b2b91e2c5fdfddf/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:06.129386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfadad-5ecc-4d35-9529-2e419fc05198 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:06.129837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfadad-5ecc-4d35-9529-2e419fc05198 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:06.130662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfadad-5ecc-4d35-9529-2e419fc05198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:06.194173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1ccfadad-5ecc-4d35-9529-2e419fc05198 None None] MFA Rules not processed for user `b5b85ef3161940908b2b91e2c5fdfddf`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:06.196092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1ccfadad-5ecc-4d35-9529-2e419fc05198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:06.332164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1088/2154] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:06.355651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:06.446189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:06.448685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90c8a7-497a-475a-8d2e-0866e4816c13 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:06.455242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:06.455242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:06.455242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:06.456291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:06.461036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:06.569011 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:06.571282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:06.582839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1067/2155] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:11.991782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25913-b43a-4746-a6bd-49dc58359263 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:11.993276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25913-b43a-4746-a6bd-49dc58359263 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:11.994026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25913-b43a-4746-a6bd-49dc58359263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:12.025253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-dbf25913-b43a-4746-a6bd-49dc58359263 None None] MFA Rules not processed for user `e4ee406036b54e8f862cbcc942fc985b`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:12.027381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-dbf25913-b43a-4746-a6bd-49dc58359263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:12.122731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1089/2156] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:13.121755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:13.245626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfb7c-0bf1-48fc-8ac3-0f92e8752abc service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:13.254315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:13.254973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:13.255259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:13.255536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] PATH_INFO: `/v3/users/209495cd85c44ba8bacebace0b7b703b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:13.257020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209495cd85c44ba8bacebace0b7b703b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:13.259032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:13.583213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209495cd85c44ba8bacebace0b7b703b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:13.710569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209495cd85c44ba8bacebace0b7b703b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:13.711499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209495cd85c44ba8bacebace0b7b703b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:13.753529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209495cd85c44ba8bacebace0b7b703b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:13.766154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209495cd85c44ba8bacebace0b7b703b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:13.788817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1068/2157] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:13 2022] DELETE /identity/v3/users/209495cd85c44ba8bacebace0b7b703b => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:13.794778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:13.795581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:13.795874 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:13.823581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:13.826557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:13.985763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1090/2158] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:14.001179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:14.003129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:14.067645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:14.134978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf45dc-afd5-422e-b70d-42c19011e687 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:14.140603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e691-4e3e-45c3-b4b5-3c1b3dede44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:14.143313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e691-4e3e-45c3-b4b5-3c1b3dede44f service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:14.143313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e691-4e3e-45c3-b4b5-3c1b3dede44f service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:14.143313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e691-4e3e-45c3-b4b5-3c1b3dede44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:14.156486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e691-4e3e-45c3-b4b5-3c1b3dede44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:14.158366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2e691-4e3e-45c3-b4b5-3c1b3dede44f service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:14.172125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1069/2159] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:14.919209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:14.922647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:14.949253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81877eef-1333-47bc-aca8-69d6066b068b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:14.955686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:14.956462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:14.956993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:14.957292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] PATH_INFO: `/v3/projects/85f56018ff2b43cf8fb4ec8f653fa8c8` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:14.958867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f56018ff2b43cf8fb4ec8f653fa8c8)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:14.961283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:14.979157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:15.179991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f56018ff2b43cf8fb4ec8f653fa8c8', 'request_id': 'req-61aa4a80-87cb-4569-8ea2-38a73af711d2'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:15.185912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f56018ff2b43cf8fb4ec8f653fa8c8', 'request_id': 'req-61aa4a80-87cb-4569-8ea2-38a73af711d2'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:15.193272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f56018ff2b43cf8fb4ec8f653fa8c8', 'request_id': 'req-61aa4a80-87cb-4569-8ea2-38a73af711d2'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:15.294210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] The token cache is being invalidate because project 85f56018ff2b43cf8fb4ec8f653fa8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:15.294469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:15.295065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-61aa4a80-87cb-4569-8ea2-38a73af711d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:15.296634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1091/2160] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:14 2022] DELETE /identity/v3/projects/85f56018ff2b43cf8fb4ec8f653fa8c8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:15.301835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938fa0-ae4f-4cb6-b8af-c31cd8378b89 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:15.302361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938fa0-ae4f-4cb6-b8af-c31cd8378b89 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:15.302361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938fa0-ae4f-4cb6-b8af-c31cd8378b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:15.327307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f4938fa0-ae4f-4cb6-b8af-c31cd8378b89 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:15.328677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f4938fa0-ae4f-4cb6-b8af-c31cd8378b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:15.406487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1070/2161] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:15.410618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476aa3b-c502-4d4f-8de9-e6f2a82b419a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:15.410618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476aa3b-c502-4d4f-8de9-e6f2a82b419a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:15.410618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476aa3b-c502-4d4f-8de9-e6f2a82b419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:15.435187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2476aa3b-c502-4d4f-8de9-e6f2a82b419a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:15.438346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2476aa3b-c502-4d4f-8de9-e6f2a82b419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:15.451886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1092/2162] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:15.456912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4938fa0-ae4f-4cb6-b8af-c31cd8378b89 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:15.470758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4938fa0-ae4f-4cb6-b8af-c31cd8378b89 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:15.478791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:15.479852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:15.480333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:15.481038 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:15.482183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:29:15.482729 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:15.485835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:15.504951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1071/2163] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:29:15.508630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476aa3b-c502-4d4f-8de9-e6f2a82b419a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:15.526666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476aa3b-c502-4d4f-8de9-e6f2a82b419a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:15.532803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:15.533520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:15.533866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:15.534146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:15.534788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:15.536758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:15.669179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1093/2164] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:29:15 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:15.674722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:15.688129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c394-9713-41c3-96ee-36ea8c595558 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:15.758387 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:15.759055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:15.759400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:15.759831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:15.760533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:15.764742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:15.874334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1072/2165] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:29:15 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:29:15.875656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:15.890702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2563-d197-4c7f-825a-806874e7483a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:15.898475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:15.899483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:15.899953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:15.900470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:15.901767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:15.903668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:15.916583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1094/2166] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:15.922517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:15.942538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2fbee-29c3-485d-8364-442350c5d01e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:15.948915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5714f-f329-4753-b5a5-41dc4264f743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:15.950059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5714f-f329-4753-b5a5-41dc4264f743 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:15.950478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5714f-f329-4753-b5a5-41dc4264f743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:15.950939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5714f-f329-4753-b5a5-41dc4264f743 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:15.951726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5714f-f329-4753-b5a5-41dc4264f743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:15.954380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5714f-f329-4753-b5a5-41dc4264f743 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:15.972122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1073/2167] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:29:15.977441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:15.993924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bb68f-b041-42f3-9943-2c82e41dedfd admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:16.001654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:16.002337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:16.002624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:16.002909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] PATH_INFO: `/v3/projects/47caffccdd2d4b28a225c06e7f30e0cb/users/db5b31d25b264b17bd91549c166e901e/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:16.020966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47caffccdd2d4b28a225c06e7f30e0cb, user_id=db5b31d25b264b17bd91549c166e901e, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:16.023778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:16.193981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1095/2168] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:15 2022] PUT /identity/v3/projects/47caffccdd2d4b28a225c06e7f30e0cb/users/db5b31d25b264b17bd91549c166e901e/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:16.199191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:16.199638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:16.199943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:16.222312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:16.224423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:16.291537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:16.327326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:16.329905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:16.346078 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1074/2169] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:16.359303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:16.361136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:16.406457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a488a7-69b0-45cd-ab3f-92bea2cc587d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:16.410749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0fc8e-622a-4a4b-b6e8-ff6dbf516a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:16.411384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0fc8e-622a-4a4b-b6e8-ff6dbf516a63 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:16.411665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0fc8e-622a-4a4b-b6e8-ff6dbf516a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:16.412121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0fc8e-622a-4a4b-b6e8-ff6dbf516a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:16.414368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0ef0fc8e-622a-4a4b-b6e8-ff6dbf516a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:16.446658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8226a1-433e-4999-b122-c0f752990588 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:16.451901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:16.452514 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:16.452899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:16.453142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:16.463026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:16.464521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:16.475420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1075/2170] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:29:16.476681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:16.503812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0fc8e-622a-4a4b-b6e8-ff6dbf516a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:16.505973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0fc8e-622a-4a4b-b6e8-ff6dbf516a63 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:16.527485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1096/2171] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:18.513821 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:18.516573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:18.673465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7128d5f-cba2-4ba8-a8a0-d28f0ef25635 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:18.686722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:18.687866 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:18.688251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:18.688539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:18.690923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:18.739235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:18.740945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:18.791146 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1076/2172] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:19.270534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:19.272534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:19.273025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:19.314758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:19.316215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:19.397306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1097/2173] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:19.498369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:19.498831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:19.668174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc80b-fec5-456e-ad35-9c4153e3e1fc service placement] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:19.677948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:19.679515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:19.679863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:19.680149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:19.702990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:19.738306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:19.743399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:19.848817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1077/2174] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:29:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:29:27.172471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:27.185831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:27.243241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac6a81-5844-4392-9007-1efc31f3c2e4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:27.285911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:27.288151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:27.288151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:27.288385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] PATH_INFO: `/v3/users/932e294dcb1245d5ab93f5b532f21560` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:27.294359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932e294dcb1245d5ab93f5b532f21560)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:27.304827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:27.340539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:27.342756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:27.375843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba67e50-01cc-4d35-b282-457e89bb152e service swift] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:27.393797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:27.396353 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:27.397009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:27.397521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] PATH_INFO: `/v3/users/1b3ac20aa386439fb54d169a3f27aa44` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:27.401068 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3ac20aa386439fb54d169a3f27aa44)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:27.422022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:27.768105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932e294dcb1245d5ab93f5b532f21560'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:27.769247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932e294dcb1245d5ab93f5b532f21560'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:27.843109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3ac20aa386439fb54d169a3f27aa44'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:27.922095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932e294dcb1245d5ab93f5b532f21560'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:27.922901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932e294dcb1245d5ab93f5b532f21560'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:27.954135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-6c986540-78bd-4a12-85db-576b9ed765f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932e294dcb1245d5ab93f5b532f21560'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:28.016515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1098/2175] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:27 2022] DELETE /identity/v3/users/932e294dcb1245d5ab93f5b532f21560 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:28.023009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:28.023457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:28.023951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:28.050514 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3ac20aa386439fb54d169a3f27aa44'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:28.051340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3ac20aa386439fb54d169a3f27aa44'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:28.090246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3ac20aa386439fb54d169a3f27aa44'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:28.102106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:28.108383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:28.118279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6ccef95b-8d78-458f-a993-adda718763fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3ac20aa386439fb54d169a3f27aa44'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:28.138982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1078/2176] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:27 2022] DELETE /identity/v3/users/1b3ac20aa386439fb54d169a3f27aa44 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:28.141005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eefa6-82b4-49a1-b0ab-1599365b2bab None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:28.144269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eefa6-82b4-49a1-b0ab-1599365b2bab None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:28.144889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eefa6-82b4-49a1-b0ab-1599365b2bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:28.217563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a37eefa6-82b4-49a1-b0ab-1599365b2bab None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:28.227465 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a37eefa6-82b4-49a1-b0ab-1599365b2bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:28.260840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:28.287584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1099/2177] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:28.332621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:28.338324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:28.467334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6285d1f-aebb-4fbe-bb21-7c23fcdc834e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:28.503789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1079/2178] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:28.519838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eefa6-82b4-49a1-b0ab-1599365b2bab None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:28.580162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c4584-3307-4272-84d6-0d7f353149a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:28.581022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4584-3307-4272-84d6-0d7f353149a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:28.581405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4584-3307-4272-84d6-0d7f353149a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:28.581788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4584-3307-4272-84d6-0d7f353149a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:28.607147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c4584-3307-4272-84d6-0d7f353149a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:28.610508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c4584-3307-4272-84d6-0d7f353149a2 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:28.648793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1100/2179] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:28.648793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969370a-66a1-4533-ab67-a7b7b1712a40 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:28.648793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969370a-66a1-4533-ab67-a7b7b1712a40 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:28.648793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969370a-66a1-4533-ab67-a7b7b1712a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:28.697491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eefa6-82b4-49a1-b0ab-1599365b2bab None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:28.707208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:28.707852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:28.708131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:28.708404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:28.744377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:28.746724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:28.750898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2969370a-66a1-4533-ab67-a7b7b1712a40 None None] MFA Rules not processed for user `db5b31d25b264b17bd91549c166e901e`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:28.752994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2969370a-66a1-4533-ab67-a7b7b1712a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:28.790717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1080/2180] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:29:29.087088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1101/2181] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:29.093248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:29.097820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:29.142423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496776-1844-47e8-8893-6e2865b8e2a0 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:29.168319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:29.170519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:29.173002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:29.173002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:29.173002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:29.183051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:29.219247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:29.370458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1081/2182] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:29:29 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:29.375494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969370a-66a1-4533-ab67-a7b7b1712a40 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:29.393857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969370a-66a1-4533-ab67-a7b7b1712a40 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:29.516494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:29.545528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:29.554976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:29.554976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:29.554976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:29.554976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:29.554976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:29.747553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1102/2183] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:29:29 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:29.748915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:29.778723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c62f5-4462-45bb-954f-1ac3ee679076 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:29.789668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:29.790473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:29.790756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:29.791047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:29.792108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:29.794111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:29.825964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:29.840331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1082/2184] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:29.851250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fe99-4cd5-40bc-b6f0-610aa90ba524 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:29.902954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:29.905311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:29.920841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:29.921534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:29.921821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:29.922095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] PATH_INFO: `/v3/projects/6130bdfbe104465e8e8d63e0fb14cd70/users/aa7f3f58cf5c44e9a2aee79c50f45bd6/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:29.940883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b45b8-0bcc-4b12-abcb-49a5efd5f96d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:29.944317 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6130bdfbe104465e8e8d63e0fb14cd70, user_id=aa7f3f58cf5c44e9a2aee79c50f45bd6, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:29.948641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:29.971663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:29.974037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:29.976216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:29.976607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] PATH_INFO: `/v3/projects/aaddfb7ec9bc49579e2a80c997463fea` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:29.983317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaddfb7ec9bc49579e2a80c997463fea)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:29.984294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:30.084843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1103/2185] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:29 2022] PUT /identity/v3/projects/6130bdfbe104465e8e8d63e0fb14cd70/users/aa7f3f58cf5c44e9a2aee79c50f45bd6/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:30.086871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:30.090905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:30.214148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaddfb7ec9bc49579e2a80c997463fea', 'request_id': 'req-c1bde984-e2c4-4410-b745-2d1fe266f4f4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.221028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f03fa2-e6b7-4d04-b5ad-003ccb1083f7 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:30.227545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaddfb7ec9bc49579e2a80c997463fea', 'request_id': 'req-c1bde984-e2c4-4410-b745-2d1fe266f4f4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.333439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:30.334881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:30.335608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:30.336057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] PATH_INFO: `/v3/projects/6da360961a664787ae7326b2158adfaf` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:30.337937 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da360961a664787ae7326b2158adfaf)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:30.341022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:30.385140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaddfb7ec9bc49579e2a80c997463fea', 'request_id': 'req-c1bde984-e2c4-4410-b745-2d1fe266f4f4'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.406291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] The token cache is being invalidate because project aaddfb7ec9bc49579e2a80c997463fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:30.407033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.408009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.410496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1083/2186] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:29 2022] DELETE /identity/v3/projects/aaddfb7ec9bc49579e2a80c997463fea => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:30.412247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:30.415264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:30.437208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde984-e2c4-4410-b745-2d1fe266f4f4 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:30.457525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:30.460235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:30.460235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:30.460235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:30.460235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:30.464196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:30.500691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1084/2187] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:30.506148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:30.551040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee83c2-bdcf-427c-870e-36006c945123 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:30.593739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da360961a664787ae7326b2158adfaf', 'request_id': 'req-d66445fc-a692-461c-b7f1-f9dcdc10b838'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.613641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da360961a664787ae7326b2158adfaf', 'request_id': 'req-d66445fc-a692-461c-b7f1-f9dcdc10b838'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.621714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:30.678089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da360961a664787ae7326b2158adfaf', 'request_id': 'req-d66445fc-a692-461c-b7f1-f9dcdc10b838'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.805593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] The token cache is being invalidate because project 6da360961a664787ae7326b2158adfaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:30.806102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.810232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:30.812405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1104/2188] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:30 2022] DELETE /identity/v3/projects/6da360961a664787ae7326b2158adfaf => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:30.818173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:30.818627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27cb7-14ca-40d9-a830-1b48c60bbe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:30.820335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:30.820641 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27cb7-14ca-40d9-a830-1b48c60bbe75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:30.821198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27cb7-14ca-40d9-a830-1b48c60bbe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:30.821798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27cb7-14ca-40d9-a830-1b48c60bbe75 admin admin] PATH_INFO: `/v3/projects/6130bdfbe104465e8e8d63e0fb14cd70/users/aa7f3f58cf5c44e9a2aee79c50f45bd6/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:30.828720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27cb7-14ca-40d9-a830-1b48c60bbe75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6130bdfbe104465e8e8d63e0fb14cd70, user_id=aa7f3f58cf5c44e9a2aee79c50f45bd6, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:30.853674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27cb7-14ca-40d9-a830-1b48c60bbe75 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:30.855889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66445fc-a692-461c-b7f1-f9dcdc10b838 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:30.868266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:30.870474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:30.870474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:30.870474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] PATH_INFO: `/v3/users/b5b85ef3161940908b2b91e2c5fdfddf` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:30.873869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b85ef3161940908b2b91e2c5fdfddf)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:30.876193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:30.907288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1085/2189] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:30 2022] PUT /identity/v3/projects/6130bdfbe104465e8e8d63e0fb14cd70/users/aa7f3f58cf5c44e9a2aee79c50f45bd6/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:31.532709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b85ef3161940908b2b91e2c5fdfddf'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:31.538292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b85ef3161940908b2b91e2c5fdfddf'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:31.695320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b85ef3161940908b2b91e2c5fdfddf'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:31.697186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b85ef3161940908b2b91e2c5fdfddf'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:31.715025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b85ef3161940908b2b91e2c5fdfddf'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:31.772442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1105/2190] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:30 2022] DELETE /identity/v3/users/b5b85ef3161940908b2b91e2c5fdfddf => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:32.020276 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda575-0766-4c42-a5de-3426efd4ed67 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:32.023247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda575-0766-4c42-a5de-3426efd4ed67 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:32.023247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda575-0766-4c42-a5de-3426efd4ed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:32.084026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-93fda575-0766-4c42-a5de-3426efd4ed67 None None] MFA Rules not processed for user `fa44c485963e4c3f9f26e36ba7d99d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:32.086440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-93fda575-0766-4c42-a5de-3426efd4ed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:32.166277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:32.223014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1086/2191] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:33.195597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:33.205777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:33.353472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3d4fd-87b8-4cf9-b1eb-6c465eb6ed49 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:33.360794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:33.361495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:33.367915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:33.367915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] PATH_INFO: `/v3/projects/7b3f5bdb9d0745e2ab2e78dc67cd5931` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:33.367915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3f5bdb9d0745e2ab2e78dc67cd5931)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:33.367915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:33.552971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3f5bdb9d0745e2ab2e78dc67cd5931', 'request_id': 'req-36b5697f-92ce-4f33-b006-5beda38218a1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.566767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3f5bdb9d0745e2ab2e78dc67cd5931', 'request_id': 'req-36b5697f-92ce-4f33-b006-5beda38218a1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.576352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3f5bdb9d0745e2ab2e78dc67cd5931', 'request_id': 'req-36b5697f-92ce-4f33-b006-5beda38218a1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.577689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:33.686909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] The token cache is being invalidate because project 7b3f5bdb9d0745e2ab2e78dc67cd5931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:33.687401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.692563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-36b5697f-92ce-4f33-b006-5beda38218a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.695400 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1106/2192] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:33 2022] DELETE /identity/v3/projects/7b3f5bdb9d0745e2ab2e78dc67cd5931 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:33.702202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af974-c554-49c0-bbc9-429ca0515e52 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:33.703123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af974-c554-49c0-bbc9-429ca0515e52 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:33.703615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af974-c554-49c0-bbc9-429ca0515e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:33.743456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-953af974-c554-49c0-bbc9-429ca0515e52 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:33.745329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-953af974-c554-49c0-bbc9-429ca0515e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:33.864882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1087/2193] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:33.873499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041139f2-0479-4a1d-bf60-32f95d87c9ea None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:33.873795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041139f2-0479-4a1d-bf60-32f95d87c9ea None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:33.874079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041139f2-0479-4a1d-bf60-32f95d87c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:33.940887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-041139f2-0479-4a1d-bf60-32f95d87c9ea None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:33.943423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-041139f2-0479-4a1d-bf60-32f95d87c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:33.974710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1107/2194] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:33.980836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953af974-c554-49c0-bbc9-429ca0515e52 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:33.994006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953af974-c554-49c0-bbc9-429ca0515e52 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:34.013811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:34.014449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:34.014731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:34.015000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:34.015671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:29:34.021644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:34.021644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:34.069581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041139f2-0479-4a1d-bf60-32f95d87c9ea None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:34.080540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041139f2-0479-4a1d-bf60-32f95d87c9ea None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:34.083116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1088/2195] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:29:34.098653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:34.101664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:34.101664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:34.101664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:34.101664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:34.102518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:34.295818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:34.297253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1108/2196] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:29:34 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:29:34.313010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf61409-6d9d-4cdd-8cdd-db929694f380 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:34.402462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:34.403128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:34.403421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:34.403754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:34.404538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:34.406669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:34.560771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:34.569231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1089/2197] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:29:34 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:34.595415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc8728-a34c-4312-afdc-df815ad39330 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:34.630647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:34.631278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:34.637214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:34.637214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:34.637214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:34.637214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:34.661060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1109/2198] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:34.665095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:34.681025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864afa20-ded5-4640-b093-2096cae18c39 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:34.736418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7cf91-19bc-414e-9a70-4ff336cc5932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:34.737933 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7cf91-19bc-414e-9a70-4ff336cc5932 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:34.738544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7cf91-19bc-414e-9a70-4ff336cc5932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:34.739028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7cf91-19bc-414e-9a70-4ff336cc5932 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:34.739979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7cf91-19bc-414e-9a70-4ff336cc5932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:34.742543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7cf91-19bc-414e-9a70-4ff336cc5932 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:34.761229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1090/2199] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:34.765391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:34.784630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe407-efd1-40c9-aa81-4ae3f08c3f4d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:34.806569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:34.809435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:34.809800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:34.810085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] PATH_INFO: `/v3/projects/5095443f4e604a3e89582cf237790452/users/b754040d32fd4af68cf1d700e1c85c2b/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:34.874314 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5095443f4e604a3e89582cf237790452, user_id=b754040d32fd4af68cf1d700e1c85c2b, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:34.877306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:35.063299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1110/2200] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:34 2022] PUT /identity/v3/projects/5095443f4e604a3e89582cf237790452/users/b754040d32fd4af68cf1d700e1c85c2b/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:35.076405 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb710a7-c0ed-4204-b5a4-41186141503d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:35.077156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb710a7-c0ed-4204-b5a4-41186141503d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:35.077627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb710a7-c0ed-4204-b5a4-41186141503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:35.201851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4bb710a7-c0ed-4204-b5a4-41186141503d None None] MFA Rules not processed for user `b754040d32fd4af68cf1d700e1c85c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:35.204212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4bb710a7-c0ed-4204-b5a4-41186141503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:35.311231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:35.351363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1091/2201] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:35.369610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:35.373062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:35.551512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d0726-9ccc-45d5-aa03-d0b77771a887 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:35.560908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:35.561554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:35.562006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:35.562301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:35.597030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:35.599339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:35.625021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1111/2202] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:46.339807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=55 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:46.732339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825c01-a8e6-48c6-bf72-dc425828fd57 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:46.733191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825c01-a8e6-48c6-bf72-dc425828fd57 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:46.733343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825c01-a8e6-48c6-bf72-dc425828fd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:46.790957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-12825c01-a8e6-48c6-bf72-dc425828fd57 None None] MFA Rules not processed for user `aa7f3f58cf5c44e9a2aee79c50f45bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:46.793286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-12825c01-a8e6-48c6-bf72-dc425828fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:46.896658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1092/2203] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:46.913406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:46.919274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:47.068372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d428f4-f6dd-44de-adf9-c0de53422559 service glance] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:47.078705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd969be-bef0-4c11-9780-0340053b38c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:47.079332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd969be-bef0-4c11-9780-0340053b38c3 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:47.097488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd969be-bef0-4c11-9780-0340053b38c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:47.097488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd969be-bef0-4c11-9780-0340053b38c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:47.097488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-abd969be-bef0-4c11-9780-0340053b38c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:47.210785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd969be-bef0-4c11-9780-0340053b38c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:47.214990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd969be-bef0-4c11-9780-0340053b38c3 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:47.236195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1112/2204] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:29:52.565646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63cf1-e2ff-4ec3-aba2-ae14df7c7f08 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:52.566216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63cf1-e2ff-4ec3-aba2-ae14df7c7f08 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:52.566216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63cf1-e2ff-4ec3-aba2-ae14df7c7f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:52.591610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-83f63cf1-e2ff-4ec3-aba2-ae14df7c7f08 None None] MFA Rules not processed for user `db5b31d25b264b17bd91549c166e901e`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:52.592959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-83f63cf1-e2ff-4ec3-aba2-ae14df7c7f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:52.601661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1093/2205] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:54.525759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745004b-7cd1-4f87-a640-b4284269635a None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:54.527373 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745004b-7cd1-4f87-a640-b4284269635a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:54.527604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745004b-7cd1-4f87-a640-b4284269635a None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:54.531722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1113/2206] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:29:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:29:54.540837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61517bb-ea73-4b6d-8ebd-c96f0c02c0e3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:54.541340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61517bb-ea73-4b6d-8ebd-c96f0c02c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:54.542171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61517bb-ea73-4b6d-8ebd-c96f0c02c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:54.574579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e61517bb-ea73-4b6d-8ebd-c96f0c02c0e3 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:54.576976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e61517bb-ea73-4b6d-8ebd-c96f0c02c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:54.593077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1094/2207] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:54.613674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745004b-7cd1-4f87-a640-b4284269635a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:54.615585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7745004b-7cd1-4f87-a640-b4284269635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:54.644160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745004b-7cd1-4f87-a640-b4284269635a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:54.649152 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191f924-a6bd-4196-a9f4-a27b21edfc13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:54.649888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191f924-a6bd-4196-a9f4-a27b21edfc13 service glance] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:54.650193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191f924-a6bd-4196-a9f4-a27b21edfc13 service glance] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:54.650743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191f924-a6bd-4196-a9f4-a27b21edfc13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:54.674930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191f924-a6bd-4196-a9f4-a27b21edfc13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:54.677005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191f924-a6bd-4196-a9f4-a27b21edfc13 service glance] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:54.692255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1114/2208] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:54.999270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08181-9545-40fb-9d9f-e7305a67c247 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:54.999625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08181-9545-40fb-9d9f-e7305a67c247 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:54.999927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08181-9545-40fb-9d9f-e7305a67c247 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:55.001525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1095/2209] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:29:55.012466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd314-310f-4bb2-bf49-d899b7c565d7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:55.012941 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd314-310f-4bb2-bf49-d899b7c565d7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:55.013601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd314-310f-4bb2-bf49-d899b7c565d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:55.041310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-091cd314-310f-4bb2-bf49-d899b7c565d7 None None] MFA Rules not processed for user `9a588483344147629a6f557a54c34c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:55.042964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-091cd314-310f-4bb2-bf49-d899b7c565d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:55.116936 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1115/2210] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:55.126985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc08181-9545-40fb-9d9f-e7305a67c247 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:55.128848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5cc08181-9545-40fb-9d9f-e7305a67c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:55.149025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc08181-9545-40fb-9d9f-e7305a67c247 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:55.153961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc888-72f0-4fa3-8a2f-251ad6042646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:55.154583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc888-72f0-4fa3-8a2f-251ad6042646 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:55.154862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc888-72f0-4fa3-8a2f-251ad6042646 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:55.155407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc888-72f0-4fa3-8a2f-251ad6042646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:55.169856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc888-72f0-4fa3-8a2f-251ad6042646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:55.171275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc888-72f0-4fa3-8a2f-251ad6042646 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:55.181381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1096/2211] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:55.290000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10e3a-faff-42e6-beff-4cfa88176bf9 None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:55.290519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10e3a-faff-42e6-beff-4cfa88176bf9 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:55.291010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10e3a-faff-42e6-beff-4cfa88176bf9 None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:55.293680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1116/2212] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:29:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:29:55.300219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608d083-bda9-480f-83a0-4306bbdb4c07 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:55.300550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608d083-bda9-480f-83a0-4306bbdb4c07 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:55.301358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608d083-bda9-480f-83a0-4306bbdb4c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:55.340531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-a608d083-bda9-480f-83a0-4306bbdb4c07 None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:55.343997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a608d083-bda9-480f-83a0-4306bbdb4c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:55.353014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1097/2213] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:55.368192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb10e3a-faff-42e6-beff-4cfa88176bf9 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:55.372493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2cb10e3a-faff-42e6-beff-4cfa88176bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:55.401111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb10e3a-faff-42e6-beff-4cfa88176bf9 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:55.405436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:55.406179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:55.406496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:55.406609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:55.424067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:55.426434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:55.444803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1117/2214] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:04.010492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e127d-0246-4d48-a18e-befb0847eb12 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:04.011708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e127d-0246-4d48-a18e-befb0847eb12 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:04.012193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e127d-0246-4d48-a18e-befb0847eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:04.035483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0b9e127d-0246-4d48-a18e-befb0847eb12 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:04.036814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0b9e127d-0246-4d48-a18e-befb0847eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:04.104343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1098/2215] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:04.117910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:04.121402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:04.157498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:04.227256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dacf0-451c-48b6-ba32-86a1974c328c service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:04.232854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bd1df-e6ee-45be-8520-12eb803db6dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:04.233482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd1df-e6ee-45be-8520-12eb803db6dd service swift] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:04.233756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd1df-e6ee-45be-8520-12eb803db6dd service swift] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:04.234464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd1df-e6ee-45be-8520-12eb803db6dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:04.244036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bd1df-e6ee-45be-8520-12eb803db6dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:04.246480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bd1df-e6ee-45be-8520-12eb803db6dd service swift] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:04.257093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1118/2216] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:30:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:14.097067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=81 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:14.252770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=23 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:14.774256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e127d-0246-4d48-a18e-befb0847eb12 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:14.892030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e127d-0246-4d48-a18e-befb0847eb12 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:14.900853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:14.902129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:14.902588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:14.903058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] PATH_INFO: `/v3/users/b754040d32fd4af68cf1d700e1c85c2b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:14.905121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b754040d32fd4af68cf1d700e1c85c2b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:14.908660 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:15.182333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b754040d32fd4af68cf1d700e1c85c2b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:15.302100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b754040d32fd4af68cf1d700e1c85c2b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:15.302943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b754040d32fd4af68cf1d700e1c85c2b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:15.327752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b754040d32fd4af68cf1d700e1c85c2b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:15.354855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b754040d32fd4af68cf1d700e1c85c2b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:15.364413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1099/2217] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:30:14 2022] DELETE /identity/v3/users/b754040d32fd4af68cf1d700e1c85c2b => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:15.370390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:15.371025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:15.371025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:15.400209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:15.402846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:15.501262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1119/2218] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:15.511073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:15.513140 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:15.607067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3ed4e-ffa8-4d9d-aca1-58a49af07fe2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:15.611275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820a927-04ce-4b01-8941-ce12093fb1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:15.611914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a927-04ce-4b01-8941-ce12093fb1fb service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:15.612193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a927-04ce-4b01-8941-ce12093fb1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:15.612468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a927-04ce-4b01-8941-ce12093fb1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:15.630596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820a927-04ce-4b01-8941-ce12093fb1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:15.632572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820a927-04ce-4b01-8941-ce12093fb1fb service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:15.645216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1100/2219] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:16.248248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:16.251257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:16.291814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f98da-e711-422e-99b1-06335cf23d5a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:16.302115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:16.303277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:16.303819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:16.304255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] PATH_INFO: `/v3/projects/5095443f4e604a3e89582cf237790452` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:16.306046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5095443f4e604a3e89582cf237790452)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:16.309589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:16.661948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5095443f4e604a3e89582cf237790452', 'request_id': 'req-c56960c7-ca7d-4b93-89aa-2f95ec376e31'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:16.673565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5095443f4e604a3e89582cf237790452', 'request_id': 'req-c56960c7-ca7d-4b93-89aa-2f95ec376e31'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:16.690023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5095443f4e604a3e89582cf237790452', 'request_id': 'req-c56960c7-ca7d-4b93-89aa-2f95ec376e31'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:17.387047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] The token cache is being invalidate because project 5095443f4e604a3e89582cf237790452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:30:17.387501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:17.390092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c56960c7-ca7d-4b93-89aa-2f95ec376e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:17.396789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1120/2220] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:30:16 2022] DELETE /identity/v3/projects/5095443f4e604a3e89582cf237790452 => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:17.399717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f98b-58d4-43a2-876b-d69d921f006b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:17.400807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f98b-58d4-43a2-876b-d69d921f006b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:17.401397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f98b-58d4-43a2-876b-d69d921f006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:17.438538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-56a6f98b-58d4-43a2-876b-d69d921f006b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:17.440264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-56a6f98b-58d4-43a2-876b-d69d921f006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:17.487090 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:17.559603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1101/2221] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:17.568401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd0ca-7bba-477a-a470-6ec52f83e04f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:17.568831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd0ca-7bba-477a-a470-6ec52f83e04f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:17.569128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd0ca-7bba-477a-a470-6ec52f83e04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:17.608503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7d9bd0ca-7bba-477a-a470-6ec52f83e04f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:17.612345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7d9bd0ca-7bba-477a-a470-6ec52f83e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:17.631897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1121/2222] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:17.654882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6f98b-58d4-43a2-876b-d69d921f006b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:17.700789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6f98b-58d4-43a2-876b-d69d921f006b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:17.707636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:17.709121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:17.710069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:17.711109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:17.712529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:30:17.713777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:17.720810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:17.772855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1102/2223] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:30:17.778771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd0ca-7bba-477a-a470-6ec52f83e04f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:17.794001 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd0ca-7bba-477a-a470-6ec52f83e04f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:17.803723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:17.805018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:17.805632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:17.806345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:17.807468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:17.813087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:17.938733 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1122/2224] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:30:17 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:30:17.944403 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:17.961733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d807f32-2df0-4eae-8641-14d3f0572d6b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:18.051041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:18.051683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:18.051971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:18.052433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:18.053172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:18.055135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:18.351069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1103/2225] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:30:17 2022] POST /identity/v3/users => generated 292 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:30:18.351634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:18.364388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041942c-4946-49d7-9173-c8bff1f18603 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:18.370701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:18.371338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:18.371610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:18.371884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:18.372679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:18.374394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:18.390756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1123/2226] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:18.392902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:18.424065 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cf33b-991d-459d-959f-dc0e240f0e85 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:18.435048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f7757-9fbe-4bf2-8a0e-07c20c55fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:18.436458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f7757-9fbe-4bf2-8a0e-07c20c55fda4 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:18.437231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f7757-9fbe-4bf2-8a0e-07c20c55fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:18.437769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f7757-9fbe-4bf2-8a0e-07c20c55fda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:18.438978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f7757-9fbe-4bf2-8a0e-07c20c55fda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:18.441941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f7757-9fbe-4bf2-8a0e-07c20c55fda4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:18.461924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1104/2227] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:30:18.474726 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:18.502223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d54bf-d12b-4085-ae3c-3ea0b76e53ca admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:18.510650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:18.516951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:18.516951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:18.516951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] PATH_INFO: `/v3/projects/46ad9f37c29c4093a97d0687a4e2793b/users/c0f4034fddec4b9d91ad1c2868a0da54/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:18.563994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ad9f37c29c4093a97d0687a4e2793b, user_id=c0f4034fddec4b9d91ad1c2868a0da54, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:18.568690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:18.684449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1124/2228] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:18 2022] PUT /identity/v3/projects/46ad9f37c29c4093a97d0687a4e2793b/users/c0f4034fddec4b9d91ad1c2868a0da54/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:18.694230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c96b-9c29-423d-bc0f-bc7abf0d5267 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:18.696619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c96b-9c29-423d-bc0f-bc7abf0d5267 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:18.698813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c96b-9c29-423d-bc0f-bc7abf0d5267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:18.768551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1c73c96b-9c29-423d-bc0f-bc7abf0d5267 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:18.777572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1c73c96b-9c29-423d-bc0f-bc7abf0d5267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:19.003611 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1105/2229] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:19.028641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:19.031061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:19.096819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:19.231971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67da08-761b-48d9-b666-96d9ea90afbc admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:19.231971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:19.231971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:19.231971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:19.232987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:19.249873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:19.253640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:19.286641 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1125/2230] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:27.104331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210d1e-6792-4884-9ab7-970eeff4ff2b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:27.105176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210d1e-6792-4884-9ab7-970eeff4ff2b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:27.105176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210d1e-6792-4884-9ab7-970eeff4ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:27.159217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-82210d1e-6792-4884-9ab7-970eeff4ff2b None None] MFA Rules not processed for user `c0f4034fddec4b9d91ad1c2868a0da54`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:27.161640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-82210d1e-6792-4884-9ab7-970eeff4ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:27.202285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:27.280126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1106/2231] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:30:27.285195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:27.297676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0526e-31b5-4def-85eb-6cd8e148d52e service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:27.303475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:27.308798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:27.308798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:27.308798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:27.308798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:27.308798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:27.501879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1126/2232] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:30:27 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:30:27.506278 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210d1e-6792-4884-9ab7-970eeff4ff2b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:27.522330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210d1e-6792-4884-9ab7-970eeff4ff2b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:27.648805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:27.648805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:27.649070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:27.649526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:27.651366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:27.653523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:27.758624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1107/2233] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:30:27 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:30:27.763982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:27.785403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1eb2-24f7-4aaa-ba59-d311a7f15da0 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:27.791186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:27.791807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:27.792078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:27.792361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:27.793036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:27.795000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:27.813123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1127/2234] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:27.814325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:27.830419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35346775-92b3-4ca0-ac26-496a835f3d16 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:27.836334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:27.837070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:27.837931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:27.838413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] PATH_INFO: `/v3/projects/53eaa26998bd45c2a50cc8199f5cb442/users/ff4386d6c84c42e5b343d54af4c2c15a/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:27.867889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53eaa26998bd45c2a50cc8199f5cb442, user_id=ff4386d6c84c42e5b343d54af4c2c15a, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:27.870214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:27.975257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1108/2235] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:27 2022] PUT /identity/v3/projects/53eaa26998bd45c2a50cc8199f5cb442/users/ff4386d6c84c42e5b343d54af4c2c15a/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:27.983218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:28.004764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7639c6-e137-4ed6-95c7-b9d561e49ed5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:28.107696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbf7f0-df93-4e25-96df-d2c03ff54d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:28.108333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbf7f0-df93-4e25-96df-d2c03ff54d95 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:28.108619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbf7f0-df93-4e25-96df-d2c03ff54d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:28.109017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbf7f0-df93-4e25-96df-d2c03ff54d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:28.109850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbf7f0-df93-4e25-96df-d2c03ff54d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:28.111596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbf7f0-df93-4e25-96df-d2c03ff54d95 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:28.128430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1128/2236] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:28.133037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:28.149815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfbd09-c50a-419c-a1ff-450fdf188289 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:28.158645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:28.159333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:28.159634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:28.159963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] PATH_INFO: `/v3/projects/53eaa26998bd45c2a50cc8199f5cb442/users/ff4386d6c84c42e5b343d54af4c2c15a/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:28.162759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53eaa26998bd45c2a50cc8199f5cb442, user_id=ff4386d6c84c42e5b343d54af4c2c15a, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:28.167824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:28.185555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1109/2237] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:28 2022] PUT /identity/v3/projects/53eaa26998bd45c2a50cc8199f5cb442/users/ff4386d6c84c42e5b343d54af4c2c15a/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:31.574603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f122-3bc5-48cd-98cf-8d3807fec502 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:31.575076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f122-3bc5-48cd-98cf-8d3807fec502 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:31.575184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f122-3bc5-48cd-98cf-8d3807fec502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:31.596352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0b36f122-3bc5-48cd-98cf-8d3807fec502 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:31.597975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0b36f122-3bc5-48cd-98cf-8d3807fec502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:31.677511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1129/2238] 10.222.0.71 () {58 vars in 967 bytes} [Fri Sep 2 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:31.707111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:31.708943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:31.814064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a0681-a7fb-4b9a-ad54-225a56034e72 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:31.823722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:31.825467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:31.825980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:31.826505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:31.838806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:31.840911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:31.846564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:31.870071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1110/2239] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:30:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:36.111304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8784f79-9b0f-4175-a45c-5bdc0ebe1397 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:36.111823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8784f79-9b0f-4175-a45c-5bdc0ebe1397 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:36.111929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8784f79-9b0f-4175-a45c-5bdc0ebe1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:36.160192 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c8784f79-9b0f-4175-a45c-5bdc0ebe1397 None None] MFA Rules not processed for user `ff4386d6c84c42e5b343d54af4c2c15a`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:36.161650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c8784f79-9b0f-4175-a45c-5bdc0ebe1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:36.208092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:36.299505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1130/2240] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:36.313747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:36.315204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:36.424108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb192a-8909-46e0-82b4-04e4496911ae service swift] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:36.438742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:36.448254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:36.449272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:36.449735 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:36.557753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:36.559581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:36.573084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1111/2241] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:36.938619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b10ee3-9478-47b3-ac40-56bf1dd2e919 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:36.939177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b10ee3-9478-47b3-ac40-56bf1dd2e919 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:36.939470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b10ee3-9478-47b3-ac40-56bf1dd2e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:36.969117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-d0b10ee3-9478-47b3-ac40-56bf1dd2e919 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:36.971240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d0b10ee3-9478-47b3-ac40-56bf1dd2e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:36.985360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1131/2242] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:30:37.001942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:37.016202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa630c20-4a64-4928-9c11-92fa902b7d69 service glance] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:37.026409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e4a15-4746-46b3-aedd-a3e797dc0a98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:37.027536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4a15-4746-46b3-aedd-a3e797dc0a98 service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:37.028069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4a15-4746-46b3-aedd-a3e797dc0a98 service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:37.028575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4a15-4746-46b3-aedd-a3e797dc0a98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:37.041111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e4a15-4746-46b3-aedd-a3e797dc0a98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:37.043016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e4a15-4746-46b3-aedd-a3e797dc0a98 service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:37.053515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1112/2243] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:46.959069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=23 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:47.049163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=54 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:48.367094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b10ee3-9478-47b3-ac40-56bf1dd2e919 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:48.427670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b10ee3-9478-47b3-ac40-56bf1dd2e919 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:48.432231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c28d4-f6b9-47c0-934b-13b756d1a35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:48.432884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c28d4-f6b9-47c0-934b-13b756d1a35b service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:48.433171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c28d4-f6b9-47c0-934b-13b756d1a35b service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:48.433447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c28d4-f6b9-47c0-934b-13b756d1a35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:48.435492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-593c28d4-f6b9-47c0-934b-13b756d1a35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:48.506027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c28d4-f6b9-47c0-934b-13b756d1a35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:48.507433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c28d4-f6b9-47c0-934b-13b756d1a35b service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:48.519115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1132/2244] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:50.053211 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697f6f-7154-4310-9ba6-c358bf0431d0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:50.053697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697f6f-7154-4310-9ba6-c358bf0431d0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:50.053904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697f6f-7154-4310-9ba6-c358bf0431d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:50.079670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e7697f6f-7154-4310-9ba6-c358bf0431d0 None None] MFA Rules not processed for user `c0f4034fddec4b9d91ad1c2868a0da54`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:50.079670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e7697f6f-7154-4310-9ba6-c358bf0431d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:50.091117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1113/2245] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:30:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:55.404082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d384b-4337-47fc-8c3e-5a8e73a55351 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:55.404668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d384b-4337-47fc-8c3e-5a8e73a55351 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:55.404668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d384b-4337-47fc-8c3e-5a8e73a55351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:55.443151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6f2d384b-4337-47fc-8c3e-5a8e73a55351 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:55.444413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6f2d384b-4337-47fc-8c3e-5a8e73a55351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:55.453377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1133/2246] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:30:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:30:55.467670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7697f6f-7154-4310-9ba6-c358bf0431d0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:55.483144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7697f6f-7154-4310-9ba6-c358bf0431d0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:55.489343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:55.489954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:55.490285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:55.490615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:55.500108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:55.501816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:55.516309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1114/2247] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:30:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:31:05.423342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=53 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:05.506969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=9 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:13.910117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d384b-4337-47fc-8c3e-5a8e73a55351 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:13.921422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d384b-4337-47fc-8c3e-5a8e73a55351 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:13.925121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:13.925728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:13.926008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:13.926296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:13.928082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:14.006582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:14.008623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:14.021262 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1134/2248] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:14.790229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:14.792350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:14.875602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bb03d-19cd-485b-b947-87879697789e service swift] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:14.879439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:14.880058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:14.880332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:14.880602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:14.882526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:14.897822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:14.899189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:14.914371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1115/2249] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:24.016008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=34 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:24.906756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=26 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:34.842142 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:34.850206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:34.862260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab84d0d-8650-4a92-9f20-806bf0a916b3 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:34.869420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:34.870045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:34.870325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:34.870600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:34.872612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:34.956104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:34.957800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:34.971069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1135/2250] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:35.956002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:35.957721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:35.972668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372f6d3-7fa4-48cd-8bfe-7fa299b3e8fe service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:35.979629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:35.980460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:35.980932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:35.981369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:35.983244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:36.059364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:36.061005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:36.070948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1116/2251] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:38.248795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:38.261154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da3757-835f-4578-a381-d83b5b9d69d4 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:38.267900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:38.268527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:38.268846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:38.269128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:38.271003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:38.347184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:38.348858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:38.359239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1136/2252] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:38.830484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:38.842716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa277-eb4e-4ca8-9495-287e2baf1fd5 service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:38.848557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94b76-a445-45be-b1d6-9dc7cf4ad730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:38.849223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94b76-a445-45be-b1d6-9dc7cf4ad730 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:38.849604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94b76-a445-45be-b1d6-9dc7cf4ad730 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:38.849876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94b76-a445-45be-b1d6-9dc7cf4ad730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:38.852678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-74f94b76-a445-45be-b1d6-9dc7cf4ad730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:38.963275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94b76-a445-45be-b1d6-9dc7cf4ad730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:38.964925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94b76-a445-45be-b1d6-9dc7cf4ad730 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:38.977127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1117/2253] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:39.334270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:39.337078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:39.349042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ab3f-bc39-4f6b-8eca-bf107a463de4 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:39.362177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:39.362802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:39.363080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:39.363356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:39.375234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:39.376950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:39.395819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1137/2254] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:31:44.592396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:44.593307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:44.593307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:44.639725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] MFA Rules not processed for user `e4ee406036b54e8f862cbcc942fc985b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:44.641394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:44.652788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1118/2255] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:45.197806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.207500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafa048-f2c8-457c-9cf9-6405a0461fd9 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.215899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3a4e5-fddf-42ce-8385-7201def353dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.217194 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a4e5-fddf-42ce-8385-7201def353dc service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.217631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a4e5-fddf-42ce-8385-7201def353dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.218107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a4e5-fddf-42ce-8385-7201def353dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.221030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4de3a4e5-fddf-42ce-8385-7201def353dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:45.235778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3a4e5-fddf-42ce-8385-7201def353dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.237371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3a4e5-fddf-42ce-8385-7201def353dc service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.247428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1138/2256] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:45.973066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.977767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:46.112199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffb7fd-547a-46f3-bef2-4c0978a54488 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:46.118635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:46.119620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:46.120066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:46.123603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:46.123603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:46.141603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:46.143766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:46.158295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1119/2257] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:31:48.086023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34377-bda9-43a3-950d-10176986a48e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:48.086909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34377-bda9-43a3-950d-10176986a48e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:48.087088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34377-bda9-43a3-950d-10176986a48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:48.109815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-64d34377-bda9-43a3-950d-10176986a48e None None] MFA Rules not processed for user `fa44c485963e4c3f9f26e36ba7d99d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:48.111313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-64d34377-bda9-43a3-950d-10176986a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:48.121650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1139/2258] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:31:55.937321 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:55.955166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bddef6-1ee6-4b00-b849-8bbd9d4aab49 service placement] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:55.969054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728dffa-7fc4-477e-8980-0ee5762d9412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:55.969689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728dffa-7fc4-477e-8980-0ee5762d9412 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:55.969976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728dffa-7fc4-477e-8980-0ee5762d9412 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:55.970252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728dffa-7fc4-477e-8980-0ee5762d9412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:55.972436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8728dffa-7fc4-477e-8980-0ee5762d9412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:56.014858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:56.028350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728dffa-7fc4-477e-8980-0ee5762d9412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:56.029847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728dffa-7fc4-477e-8980-0ee5762d9412 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:56.044987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1120/2259] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:57.480635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34377-bda9-43a3-950d-10176986a48e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:57.550013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34377-bda9-43a3-950d-10176986a48e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:57.557732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:57.559245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:57.559375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:57.559672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:57.561583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:57.591812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:57.592251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:57.606437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1140/2260] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:01.550284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27444a-78bf-4844-962b-8193fdca5d67 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:01.550912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27444a-78bf-4844-962b-8193fdca5d67 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:01.550912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27444a-78bf-4844-962b-8193fdca5d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:01.585721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6d27444a-78bf-4844-962b-8193fdca5d67 None None] MFA Rules not processed for user `1f12fa71a876411f91c2bbaf3c9080ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:01.587491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6d27444a-78bf-4844-962b-8193fdca5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:01.597218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1121/2261] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:07.601998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:09.063700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:09.077544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712506a5-8be9-4d28-8659-9eb05230b0c2 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:09.085076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8287c-618a-436c-92d6-974348e101b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:09.087824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8287c-618a-436c-92d6-974348e101b4 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:09.088393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8287c-618a-436c-92d6-974348e101b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:09.101212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8287c-618a-436c-92d6-974348e101b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:09.113906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4bd8287c-618a-436c-92d6-974348e101b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:09.141171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8287c-618a-436c-92d6-974348e101b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:09.143243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8287c-618a-436c-92d6-974348e101b4 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:09.157425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1141/2262] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:11.568650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=6 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:17.977759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27444a-78bf-4844-962b-8193fdca5d67 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:17.991215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27444a-78bf-4844-962b-8193fdca5d67 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:17.996837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:17.997486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.997767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.998043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.999848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:18.013686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:18.015312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:18.028441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1122/2263] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:19.151328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=6 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:28.023348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=6 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:49.980500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2807-7a83-4849-b329-0d1cd50d4949 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:49.981137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2807-7a83-4849-b329-0d1cd50d4949 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:49.981137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2807-7a83-4849-b329-0d1cd50d4949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:50.001789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-5aee2807-7a83-4849-b329-0d1cd50d4949 None None] MFA Rules not processed for user `e43f913fbce54697b3261efc93ad9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:50.003022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5aee2807-7a83-4849-b329-0d1cd50d4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:50.010239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1142/2264] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:50.334352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:50.354225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b66f-2061-4d9d-90b8-0cf95fe18651 service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:50.363722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:50.363722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:50.363722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:50.363722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:50.364135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:50.385418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:50.386894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:50.395019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1123/2265] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:32:59.995850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:00.391581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=15 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:30.637183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee2807-7a83-4849-b329-0d1cd50d4949 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:30.654658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee2807-7a83-4849-b329-0d1cd50d4949 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:30.659121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:30.659908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:30.660434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:30.660821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:30.663461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:30.818025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:30.819783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:30.860662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1143/2266] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:35.446540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:35.459987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae147-33c8-4aa5-b5f9-055407840e43 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:35.467649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:35.468398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:35.468757 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:35.469177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:35.471725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:35.492160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:35.495164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:35.506768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1124/2267] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:35.635104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:35.636187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:35.648873 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565aab9-847a-4b26-977a-ad9b95a07088 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:35.654305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:35.655159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:35.655449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:35.655723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] PATH_INFO: `/v3/users/fa44c485963e4c3f9f26e36ba7d99d9c` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:35.656969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa44c485963e4c3f9f26e36ba7d99d9c)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:35.658905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:35.940105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa44c485963e4c3f9f26e36ba7d99d9c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:35.940886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa44c485963e4c3f9f26e36ba7d99d9c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:36.125688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa44c485963e4c3f9f26e36ba7d99d9c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:36.128351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa44c485963e4c3f9f26e36ba7d99d9c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:36.147568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77bf543c-4764-4ef1-9f32-334e51dd9fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa44c485963e4c3f9f26e36ba7d99d9c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:36.172890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1144/2268] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:33:35 2022] DELETE /identity/v3/users/fa44c485963e4c3f9f26e36ba7d99d9c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:36.600860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:36.621597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0025d7f-dc68-4dd7-b833-520c3146c231 service placement] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:36.708681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:36.709428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:36.709767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:36.710075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] PATH_INFO: `/v3/projects/398a5c8f96574b19bcb400865d6e1536` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:36.711739 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398a5c8f96574b19bcb400865d6e1536)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:36.713798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:36.895588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398a5c8f96574b19bcb400865d6e1536', 'request_id': 'req-3d5cc5ef-0666-4840-8bf9-f94d9994c792'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:36.905766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398a5c8f96574b19bcb400865d6e1536', 'request_id': 'req-3d5cc5ef-0666-4840-8bf9-f94d9994c792'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:37.017190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398a5c8f96574b19bcb400865d6e1536', 'request_id': 'req-3d5cc5ef-0666-4840-8bf9-f94d9994c792'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:37.038171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] The token cache is being invalidate because project 398a5c8f96574b19bcb400865d6e1536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:33:37.038814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:37.040086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-3d5cc5ef-0666-4840-8bf9-f94d9994c792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:37.042787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1125/2269] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:33:36 2022] DELETE /identity/v3/projects/398a5c8f96574b19bcb400865d6e1536 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:37.050836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95e3e-6aca-4ff3-b907-7fc4c5f3e151 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:37.051421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95e3e-6aca-4ff3-b907-7fc4c5f3e151 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:37.051421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95e3e-6aca-4ff3-b907-7fc4c5f3e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:37.142235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:37.156957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b5c95e3e-6aca-4ff3-b907-7fc4c5f3e151 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:37.156957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b5c95e3e-6aca-4ff3-b907-7fc4c5f3e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:37.251865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1145/2270] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:37.267182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbaf0e-3739-494f-a434-052ae89b590c None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:37.267735 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbaf0e-3739-494f-a434-052ae89b590c None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:37.268247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbaf0e-3739-494f-a434-052ae89b590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:37.306415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c9dbaf0e-3739-494f-a434-052ae89b590c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:37.309244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c9dbaf0e-3739-494f-a434-052ae89b590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:37.324900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1126/2271] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:37.327750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95e3e-6aca-4ff3-b907-7fc4c5f3e151 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:37.350267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95e3e-6aca-4ff3-b907-7fc4c5f3e151 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:37.360552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:37.361427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:37.362084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:37.362470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:37.363319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:33:37.363777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:37.366440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:37.407228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1146/2272] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:33:37.412692 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbaf0e-3739-494f-a434-052ae89b590c None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:37.428362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbaf0e-3739-494f-a434-052ae89b590c None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:37.443051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:37.444243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:37.444580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:37.444894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:37.445633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:37.448242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:37.603496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1127/2273] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:33:37 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:37.609778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:37.627875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14205ef5-f14f-491d-a0bd-1a612ee3b47b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:37.765619 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:37.766804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:37.767235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:37.767675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:37.768449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:37.770915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:37.947205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1147/2274] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:33:37 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:37.949214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:37.964176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef5ecb-0dbf-46cf-b730-642bac71521d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:37.971583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:37.980551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:37.980551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:37.980551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:37.980551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:37.980551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:38.000770 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1128/2275] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:38.001767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:38.016691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5f258-ce55-4fa4-9c4a-20d878e3bf56 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:38.051515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47941a2-c455-4e89-ad3b-4b315a2799fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:38.051515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47941a2-c455-4e89-ad3b-4b315a2799fd admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:38.051515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47941a2-c455-4e89-ad3b-4b315a2799fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:38.051515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47941a2-c455-4e89-ad3b-4b315a2799fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:38.054908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47941a2-c455-4e89-ad3b-4b315a2799fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:38.060601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47941a2-c455-4e89-ad3b-4b315a2799fd admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:38.094946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1148/2276] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:38.098426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:38.128787 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78616e-a9fb-41b8-8611-e30d06b322f4 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:38.139525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:38.140344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:38.140631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:38.140937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] PATH_INFO: `/v3/projects/b326ba47344a48bfa4af43c3620eb2af/users/e4ebd3fc3f044d57b171347e6f7ca00d/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:38.171452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b326ba47344a48bfa4af43c3620eb2af, user_id=e4ebd3fc3f044d57b171347e6f7ca00d, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:38.175818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:38.282827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1129/2277] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:33:38 2022] PUT /identity/v3/projects/b326ba47344a48bfa4af43c3620eb2af/users/e4ebd3fc3f044d57b171347e6f7ca00d/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:38.300398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908daf-aaf6-4cd4-9e7d-d9a778253939 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:38.301162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908daf-aaf6-4cd4-9e7d-d9a778253939 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:38.301598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908daf-aaf6-4cd4-9e7d-d9a778253939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:38.341734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1b908daf-aaf6-4cd4-9e7d-d9a778253939 None None] MFA Rules not processed for user `e4ebd3fc3f044d57b171347e6f7ca00d`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:38.356422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1b908daf-aaf6-4cd4-9e7d-d9a778253939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:38.512997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1149/2278] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:38.525528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:38.530143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:38.536608 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:38.636460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aad54-5808-40c0-98ef-0dc087f7e19a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:38.647753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:38.649439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:38.649954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:38.651111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:38.668753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:38.671583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:38.701399 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1130/2279] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:33:44.568126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73669f-8254-412d-9905-89d4f2e21a26 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:44.568863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73669f-8254-412d-9905-89d4f2e21a26 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:44.568863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73669f-8254-412d-9905-89d4f2e21a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:44.578128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:44.591765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-da73669f-8254-412d-9905-89d4f2e21a26 None None] MFA Rules not processed for user `e4ee406036b54e8f862cbcc942fc985b`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:44.592981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-da73669f-8254-412d-9905-89d4f2e21a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:44.659961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1150/2280] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:47.090620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:47.186552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85930a-2600-4d91-91e8-8bb585e75b86 service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:47.191211 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:47.191850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:47.192125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:47.192517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] PATH_INFO: `/v3/users/e4ebd3fc3f044d57b171347e6f7ca00d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:47.193632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ebd3fc3f044d57b171347e6f7ca00d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:47.195556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:47.545917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ebd3fc3f044d57b171347e6f7ca00d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:47.657039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ebd3fc3f044d57b171347e6f7ca00d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:47.657691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ebd3fc3f044d57b171347e6f7ca00d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:47.678551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ebd3fc3f044d57b171347e6f7ca00d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:47.690198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ebd3fc3f044d57b171347e6f7ca00d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:47.698244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1131/2281] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:33:47 2022] DELETE /identity/v3/users/e4ebd3fc3f044d57b171347e6f7ca00d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:47.703128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:47.703649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:47.703949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:47.729463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:47.730682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:47.796326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1151/2282] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:33:47.806870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:47.808371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:47.819513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:47.873412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86949f-bbd2-4725-abf7-c4392436f7bf admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:47.877337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eeea99-3e99-4344-9ec5-98c0109eb83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:47.877983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeea99-3e99-4344-9ec5-98c0109eb83e service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:47.878258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeea99-3e99-4344-9ec5-98c0109eb83e service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:47.878527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeea99-3e99-4344-9ec5-98c0109eb83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:47.893767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eeea99-3e99-4344-9ec5-98c0109eb83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:47.896441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eeea99-3e99-4344-9ec5-98c0109eb83e service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:47.914331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1132/2283] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:48.512804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:48.514277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:48.528387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39ab9e-7d69-4620-b6cc-5f406b878730 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:48.538667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:48.538667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:48.538667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:48.538667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] PATH_INFO: `/v3/projects/b326ba47344a48bfa4af43c3620eb2af` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:48.539442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b326ba47344a48bfa4af43c3620eb2af)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:48.540569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:48.741434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b326ba47344a48bfa4af43c3620eb2af', 'request_id': 'req-a4c69eda-0cbe-4479-bec6-565214d230b8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:48.749019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b326ba47344a48bfa4af43c3620eb2af', 'request_id': 'req-a4c69eda-0cbe-4479-bec6-565214d230b8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:48.760079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b326ba47344a48bfa4af43c3620eb2af', 'request_id': 'req-a4c69eda-0cbe-4479-bec6-565214d230b8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:48.923932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] The token cache is being invalidate because project b326ba47344a48bfa4af43c3620eb2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:33:48.923932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:48.929140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a4c69eda-0cbe-4479-bec6-565214d230b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:48.931003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1152/2284] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:33:48 2022] DELETE /identity/v3/projects/b326ba47344a48bfa4af43c3620eb2af => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:48.937089 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f38bc-a275-4c31-98cf-be07e6805209 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:48.937616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f38bc-a275-4c31-98cf-be07e6805209 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:48.937616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f38bc-a275-4c31-98cf-be07e6805209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:48.960133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-fd3f38bc-a275-4c31-98cf-be07e6805209 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:48.961453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fd3f38bc-a275-4c31-98cf-be07e6805209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:49.018103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a176a3-2889-4a6b-8c54-16810bf7332e None None] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.020193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a176a3-2889-4a6b-8c54-16810bf7332e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.020193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a176a3-2889-4a6b-8c54-16810bf7332e None None] PATH_INFO: `/` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.022331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1153/2285] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:33:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:33:49.032130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.032883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.033498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.072799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1133/2286] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:33:49.081425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e79b-86c2-4486-8719-33ff597cc68b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.081772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e79b-86c2-4486-8719-33ff597cc68b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.082006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e79b-86c2-4486-8719-33ff597cc68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.088385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] MFA Rules not processed for user `9a588483344147629a6f557a54c34c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:49.090700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:49.112510 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b2e0e79b-86c2-4486-8719-33ff597cc68b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:49.113769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b2e0e79b-86c2-4486-8719-33ff597cc68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:49.140775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:49.143681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1134/2287] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:33:49.147467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0e79b-86c2-4486-8719-33ff597cc68b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.160903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0e79b-86c2-4486-8719-33ff597cc68b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.173800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.175942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.177194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.177484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.178222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:33:49.178538 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.180250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.202910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1135/2288] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:33:49.216806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.224777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1154/2289] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:49.232010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdbc47-2d91-40eb-9276-6ea3d918ab65 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.239772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.243975 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:49.244124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2440fe-5681-4699-928c-2668bfd4f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.244124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2440fe-5681-4699-928c-2668bfd4f1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.244124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2440fe-5681-4699-928c-2668bfd4f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.244124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2440fe-5681-4699-928c-2668bfd4f1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.245359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2440fe-5681-4699-928c-2668bfd4f1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.248150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2440fe-5681-4699-928c-2668bfd4f1e0 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.253185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3ef72-712f-4bb7-b50a-0cd38ae3e28c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.259275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.260476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.261000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.261552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.272474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.276804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.294757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1155/2290] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:33:49.387569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1136/2291] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:33:49 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:49.392853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.397634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ce2d-4785-4189-ba01-5a5637c2c1d5 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.397924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ce2d-4785-4189-ba01-5a5637c2c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.398198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ce2d-4785-4189-ba01-5a5637c2c1d5 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.401293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1137/2292] 10.222.0.71 () {54 vars in 921 bytes} [Fri Sep 2 21:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:33:49.411868 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe9b8-2d24-4954-b283-7567be9e21e9 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.422852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.422852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.422852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.442628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] MFA Rules not processed for user `a55753c439f54804814aca0a3feb96ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:49.445034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:49.490799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.491424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.491716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.491966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.492601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.494711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.537433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1138/2293] 10.222.0.71 () {58 vars in 1018 bytes} [Fri Sep 2 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:49.550045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.551507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:49.556662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:49.622781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5891a-c80a-4fc5-a5a3-e7762bbae02a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.626776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.627691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.627969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.628248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.641357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.642910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.658216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1139/2294] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:33:49.700223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1156/2295] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:33:49 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:49.704845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.719832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c56c5-3d93-4cd5-a5ca-a5bf5800ce9c service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.726327 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.727062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.727409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.727741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.728413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.736908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.744792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1140/2296] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:33:49.749962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.764522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ecc21-cfa0-44f2-8a69-565c5fc16bed admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.777940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a74de-5dc3-4a9d-b4a5-f0e2923969a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.778949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a74de-5dc3-4a9d-b4a5-f0e2923969a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.779628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a74de-5dc3-4a9d-b4a5-f0e2923969a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.780181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a74de-5dc3-4a9d-b4a5-f0e2923969a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.781360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a74de-5dc3-4a9d-b4a5-f0e2923969a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.783671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a74de-5dc3-4a9d-b4a5-f0e2923969a9 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.800685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1157/2297] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:49.806670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:49.818527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fcce-b036-4af0-a64d-ad2aaf923f46 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:49.824325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:49.824902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.825272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.825633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] PATH_INFO: `/v3/projects/117dfa19013a43a8a5b4a12cbc7f56f3/users/74400becd5444420bf6132c75c0339e1/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:49.844528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=117dfa19013a43a8a5b4a12cbc7f56f3, user_id=74400becd5444420bf6132c75c0339e1, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:49.847282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:49.956586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1141/2298] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:33:49 2022] PUT /identity/v3/projects/117dfa19013a43a8a5b4a12cbc7f56f3/users/74400becd5444420bf6132c75c0339e1/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:49.969286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5c48-cbc7-48aa-b8ef-58c707b5fa98 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:49.969828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5c48-cbc7-48aa-b8ef-58c707b5fa98 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:49.970303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5c48-cbc7-48aa-b8ef-58c707b5fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:50.011499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0ede5c48-cbc7-48aa-b8ef-58c707b5fa98 None None] MFA Rules not processed for user `74400becd5444420bf6132c75c0339e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:50.012776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0ede5c48-cbc7-48aa-b8ef-58c707b5fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:50.144782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1158/2299] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:50.155877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:50.159338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:50.344199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b127f-b19e-48a6-be45-dd5478dba6ca admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:50.354808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d04d61-9d54-46fe-9564-5fa7fe20842d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:50.365101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d04d61-9d54-46fe-9564-5fa7fe20842d service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:50.365101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d04d61-9d54-46fe-9564-5fa7fe20842d service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:50.365101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d04d61-9d54-46fe-9564-5fa7fe20842d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:50.367563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d04d61-9d54-46fe-9564-5fa7fe20842d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:50.370444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d04d61-9d54-46fe-9564-5fa7fe20842d service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:50.392499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1142/2300] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:33:54.150274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5c48-cbc7-48aa-b8ef-58c707b5fa98 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:54.192671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:54.234798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5c48-cbc7-48aa-b8ef-58c707b5fa98 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:54.240675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:54.241347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:54.241629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:54.241900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] PATH_INFO: `/v3/users/74400becd5444420bf6132c75c0339e1` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:54.243157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74400becd5444420bf6132c75c0339e1)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:54.245357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:54.551172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74400becd5444420bf6132c75c0339e1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:54.551746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74400becd5444420bf6132c75c0339e1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:54.690769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74400becd5444420bf6132c75c0339e1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:54.691420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74400becd5444420bf6132c75c0339e1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:54.700309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74400becd5444420bf6132c75c0339e1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:54.720816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1159/2301] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:33:54 2022] DELETE /identity/v3/users/74400becd5444420bf6132c75c0339e1 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:54.725655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:54.726062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:54.726359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:54.880172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:54.881614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:54.910652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:54.955537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1143/2302] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:33:54.967613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:54.969478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:55.039237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0061af-71de-4388-87ec-035e3ad3aef2 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:55.044461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102f099-a850-40a2-8c9a-4813b664f957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:55.045420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f099-a850-40a2-8c9a-4813b664f957 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:55.045830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f099-a850-40a2-8c9a-4813b664f957 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:55.046310 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102f099-a850-40a2-8c9a-4813b664f957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:55.060273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102f099-a850-40a2-8c9a-4813b664f957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:55.063297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102f099-a850-40a2-8c9a-4813b664f957 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:55.076218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1160/2303] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:56.067800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:56.069449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:56.082819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354407b-aa47-496c-8b3a-7e8eb27e674b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:56.091154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:56.091993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:56.092272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:56.092541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] PATH_INFO: `/v3/projects/117dfa19013a43a8a5b4a12cbc7f56f3` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:56.093754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117dfa19013a43a8a5b4a12cbc7f56f3)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:56.095808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:56.278125 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117dfa19013a43a8a5b4a12cbc7f56f3', 'request_id': 'req-ba4deb66-451a-4341-b68e-ee7b79f9fc63'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:56.284792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117dfa19013a43a8a5b4a12cbc7f56f3', 'request_id': 'req-ba4deb66-451a-4341-b68e-ee7b79f9fc63'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:56.448887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117dfa19013a43a8a5b4a12cbc7f56f3', 'request_id': 'req-ba4deb66-451a-4341-b68e-ee7b79f9fc63'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:56.495630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] The token cache is being invalidate because project 117dfa19013a43a8a5b4a12cbc7f56f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:33:56.495958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:56.496685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ba4deb66-451a-4341-b68e-ee7b79f9fc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:56.498852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1144/2304] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:33:56 2022] DELETE /identity/v3/projects/117dfa19013a43a8a5b4a12cbc7f56f3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:56.503701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5b21f-3445-42fb-8b32-903e8efd008f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:56.504597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5b21f-3445-42fb-8b32-903e8efd008f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:56.505069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5b21f-3445-42fb-8b32-903e8efd008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:56.528347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-33b5b21f-3445-42fb-8b32-903e8efd008f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:56.530028 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-33b5b21f-3445-42fb-8b32-903e8efd008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:56.599631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:56.625695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1161/2305] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:56.633907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465da0b-06e0-43e2-92e8-2bf8b7269bf9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:56.634227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465da0b-06e0-43e2-92e8-2bf8b7269bf9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:56.634617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465da0b-06e0-43e2-92e8-2bf8b7269bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:56.658846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6465da0b-06e0-43e2-92e8-2bf8b7269bf9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:56.660562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6465da0b-06e0-43e2-92e8-2bf8b7269bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:56.671323 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1145/2306] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:56.675810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5b21f-3445-42fb-8b32-903e8efd008f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:56.690524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5b21f-3445-42fb-8b32-903e8efd008f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:56.696326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:56.697497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:56.697625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:56.697841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:56.698470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:33:56.698869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:56.700572 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:56.714575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1162/2307] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:33:56.719408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465da0b-06e0-43e2-92e8-2bf8b7269bf9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:56.733619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465da0b-06e0-43e2-92e8-2bf8b7269bf9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:56.740414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:56.741161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:56.741507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:56.741997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:56.742749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:56.745517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:56.930681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1146/2308] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:33:56 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:56.935175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:56.945841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e99c3-e05d-4939-945e-27d723e1a173 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.007489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.008103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.008436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.008721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.010285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:57.012240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:57.124314 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1163/2309] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:33:56 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:57.127794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:57.141520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52081d-1f5c-4c8b-85f9-d0bcb45fa30b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.147426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.148036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.148302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.148957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.149662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:57.151976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:57.163153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1147/2310] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:33:57.167477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:57.179826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141e42a-84be-49bf-b95c-80ed634190dd admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.185819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aea58-1f52-4a48-bb21-dddb2d19c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.186445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aea58-1f52-4a48-bb21-dddb2d19c94d admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.186849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aea58-1f52-4a48-bb21-dddb2d19c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.187185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aea58-1f52-4a48-bb21-dddb2d19c94d admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.187866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aea58-1f52-4a48-bb21-dddb2d19c94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:57.189513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aea58-1f52-4a48-bb21-dddb2d19c94d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:57.207043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1164/2311] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:57.213322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:57.223702 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde93c5-495d-4751-87e8-5276bf6a6809 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.228846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.229496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.229772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.230047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] PATH_INFO: `/v3/projects/6ec2f53055f1485b991802a66cde51a3/users/a04ace07dcc94b94a3f35b5ab98712b9/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.246420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec2f53055f1485b991802a66cde51a3, user_id=a04ace07dcc94b94a3f35b5ab98712b9, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:57.249367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:57.382132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1148/2312] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:33:57 2022] PUT /identity/v3/projects/6ec2f53055f1485b991802a66cde51a3/users/a04ace07dcc94b94a3f35b5ab98712b9/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:33:57.394162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e822-b0ce-43e2-8c48-d4bddc5c6f12 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.394447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e822-b0ce-43e2-8c48-d4bddc5c6f12 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.394731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e822-b0ce-43e2-8c48-d4bddc5c6f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.425180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-68c2e822-b0ce-43e2-8c48-d4bddc5c6f12 None None] MFA Rules not processed for user `a04ace07dcc94b94a3f35b5ab98712b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:57.427686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-68c2e822-b0ce-43e2-8c48-d4bddc5c6f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:57.508199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1165/2313] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:57.513469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:57.563868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:57.577897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55dea8-5f4a-40f4-bad7-41898406132c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.582677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.583280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.583557 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.583828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.584476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:57.586550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:57.703766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1149/2314] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:33:57 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:57.708557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2e822-b0ce-43e2-8c48-d4bddc5c6f12 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:57.720837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2e822-b0ce-43e2-8c48-d4bddc5c6f12 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.789422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:57.812058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.812799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.813147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.813513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.814217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:57.816211 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:57.928538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1166/2315] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:33:57 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:57.929909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:57.941208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd5885-8542-45cf-a4ec-51cf3f361ad9 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.945810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.946460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.946743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.947010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:57.947659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:57.949291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:57.959747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1150/2316] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:57.964828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:57.976307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086b623-a662-494c-9c26-b931e924454d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:57.983359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:57.984102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:57.984448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:57.984816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] PATH_INFO: `/v3/projects/4b9620c87d8042029df94195ab37f921/users/3824a418595748569d9e2ac61e05253e/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:58.007253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9620c87d8042029df94195ab37f921, user_id=3824a418595748569d9e2ac61e05253e, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:58.010900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:58.097392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1167/2317] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:33:57 2022] PUT /identity/v3/projects/4b9620c87d8042029df94195ab37f921/users/3824a418595748569d9e2ac61e05253e/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:58.100119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:58.117237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b24e0-bc99-4ccb-8a88-73a22ffdb657 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:58.181747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a94bd-15c5-4604-b6df-e227c194c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:58.182407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a94bd-15c5-4604-b6df-e227c194c7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:58.182613 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a94bd-15c5-4604-b6df-e227c194c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:58.182925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a94bd-15c5-4604-b6df-e227c194c7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:58.183561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a94bd-15c5-4604-b6df-e227c194c7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:58.185176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a94bd-15c5-4604-b6df-e227c194c7b0 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:58.196101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1151/2318] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:58.201393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:58.213802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb9da-d2ab-48d7-8e99-2f81f7dcca77 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:58.218632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:58.225997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:58.225997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:58.225997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] PATH_INFO: `/v3/projects/4b9620c87d8042029df94195ab37f921/users/3824a418595748569d9e2ac61e05253e/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:58.225997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9620c87d8042029df94195ab37f921, user_id=3824a418595748569d9e2ac61e05253e, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:58.225997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:58.236533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1168/2319] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:33:58 2022] PUT /identity/v3/projects/4b9620c87d8042029df94195ab37f921/users/3824a418595748569d9e2ac61e05253e/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:58.250473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cb30-d7ba-4a52-8d55-bf4c2559c654 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:58.250754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cb30-d7ba-4a52-8d55-bf4c2559c654 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:58.251048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652cb30-d7ba-4a52-8d55-bf4c2559c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:58.288608 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8652cb30-d7ba-4a52-8d55-bf4c2559c654 None None] MFA Rules not processed for user `3824a418595748569d9e2ac61e05253e`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:58.289878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8652cb30-d7ba-4a52-8d55-bf4c2559c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:58.379515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1152/2320] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:33:58.393802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:58.396473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:58.512924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db91ce-f3b4-437a-8f08-528902837c61 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:58.516940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee677-c9c2-4820-96c7-0aca80b4191a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:58.517581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee677-c9c2-4820-96c7-0aca80b4191a service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:58.517891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee677-c9c2-4820-96c7-0aca80b4191a service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:58.518164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee677-c9c2-4820-96c7-0aca80b4191a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:58.531499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee677-c9c2-4820-96c7-0aca80b4191a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:58.533048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee677-c9c2-4820-96c7-0aca80b4191a service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:58.547756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1169/2321] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:33:59.966028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652cb30-d7ba-4a52-8d55-bf4c2559c654 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:00.012634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:00.032314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652cb30-d7ba-4a52-8d55-bf4c2559c654 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:00.037340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:00.038156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:00.038439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:00.038700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] PATH_INFO: `/v3/users/a04ace07dcc94b94a3f35b5ab98712b9` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:00.039934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04ace07dcc94b94a3f35b5ab98712b9)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:00.042247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:00.372833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04ace07dcc94b94a3f35b5ab98712b9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:00.512513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04ace07dcc94b94a3f35b5ab98712b9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:00.513457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04ace07dcc94b94a3f35b5ab98712b9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:00.539616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04ace07dcc94b94a3f35b5ab98712b9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:00.550671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04ace07dcc94b94a3f35b5ab98712b9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:00.567805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1153/2322] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:33:59 2022] DELETE /identity/v3/users/a04ace07dcc94b94a3f35b5ab98712b9 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:00.569926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:00.570427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:00.570520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:00.595801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:00.597231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:00.670527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1170/2323] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:00.682016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:00.685541 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:00.783306 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153fcea-dacd-4c5e-8353-ee16b6051067 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:00.787451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:00.788130 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:00.788409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:00.788677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:00.805401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:00.805401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:00.813975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1154/2324] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:01.284457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:01.286424 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:01.307749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedb601-e744-4170-a8c4-3251ec3627ee None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:01.316284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:01.317491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:01.317976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:01.318388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] PATH_INFO: `/v3/projects/6ec2f53055f1485b991802a66cde51a3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:01.319910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec2f53055f1485b991802a66cde51a3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:01.323097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:01.348972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:01.489915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec2f53055f1485b991802a66cde51a3', 'request_id': 'req-9f8e7b00-569b-4e32-9437-646c2b75d58d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:01.497959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec2f53055f1485b991802a66cde51a3', 'request_id': 'req-9f8e7b00-569b-4e32-9437-646c2b75d58d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:01.510039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec2f53055f1485b991802a66cde51a3', 'request_id': 'req-9f8e7b00-569b-4e32-9437-646c2b75d58d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:01.606838 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] The token cache is being invalidate because project 6ec2f53055f1485b991802a66cde51a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:01.607487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:01.612237 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:01.615063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1171/2325] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:01 2022] DELETE /identity/v3/projects/6ec2f53055f1485b991802a66cde51a3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:01.619324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:01.632233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc665719-5f75-40cd-9cbc-272ffdcf2483 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:01.719398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:01.720415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:01.720884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:01.722002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] PATH_INFO: `/v3/users/3824a418595748569d9e2ac61e05253e` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:01.723225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3824a418595748569d9e2ac61e05253e)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:01.727389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:01.738055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:01.977042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3824a418595748569d9e2ac61e05253e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:02.056563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3824a418595748569d9e2ac61e05253e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:02.062050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3824a418595748569d9e2ac61e05253e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:02.073865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3824a418595748569d9e2ac61e05253e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:02.082343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-eb357d8a-600e-4d77-84bb-a07dc932cfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3824a418595748569d9e2ac61e05253e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:02.088922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1155/2326] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:01 2022] DELETE /identity/v3/users/3824a418595748569d9e2ac61e05253e => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:02.790929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:02.792990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:02.812116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7b00-569b-4e32-9437-646c2b75d58d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:02.930511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:02.931338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:02.931628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:02.932044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] PATH_INFO: `/v3/projects/4b9620c87d8042029df94195ab37f921` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:02.933514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9620c87d8042029df94195ab37f921)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:02.935789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:03.166801 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9620c87d8042029df94195ab37f921', 'request_id': 'req-d753ed91-a562-4c00-95ce-ec5833858db8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:03.177175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9620c87d8042029df94195ab37f921', 'request_id': 'req-d753ed91-a562-4c00-95ce-ec5833858db8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:03.188205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9620c87d8042029df94195ab37f921', 'request_id': 'req-d753ed91-a562-4c00-95ce-ec5833858db8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:03.375366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] The token cache is being invalidate because project 4b9620c87d8042029df94195ab37f921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:03.377570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:03.379185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d753ed91-a562-4c00-95ce-ec5833858db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:03.387604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1172/2327] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:02 2022] DELETE /identity/v3/projects/4b9620c87d8042029df94195ab37f921 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:03.398495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f8918-c8f6-4ef0-8516-194792e3a8f8 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:03.399743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f8918-c8f6-4ef0-8516-194792e3a8f8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:03.399743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f8918-c8f6-4ef0-8516-194792e3a8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:03.433304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-373f8918-c8f6-4ef0-8516-194792e3a8f8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:03.434630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-373f8918-c8f6-4ef0-8516-194792e3a8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:03.533904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1156/2328] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:03.543848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a032be-7c79-411d-9d81-223a7dfdda9b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:03.544154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a032be-7c79-411d-9d81-223a7dfdda9b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:03.544322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a032be-7c79-411d-9d81-223a7dfdda9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:03.563913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:03.564242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:03.564626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:03.567467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c3a032be-7c79-411d-9d81-223a7dfdda9b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:03.569185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c3a032be-7c79-411d-9d81-223a7dfdda9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:03.586405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1173/2329] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:03.591689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a032be-7c79-411d-9d81-223a7dfdda9b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:03.591879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:03.593074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:03.608114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a032be-7c79-411d-9d81-223a7dfdda9b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:03.619199 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:03.621389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:03.623599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:03.624397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:03.626110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:34:03.627008 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:03.631122 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:03.669153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1174/2330] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:34:03.670770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:03.699396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c72f-5d10-4d10-8333-e06dd219f7dd admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:03.707963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:03.709671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:03.709671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:03.709671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:03.710601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:03.713861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:03.731194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1157/2331] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:03.735543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:03.794513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:03.796471 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:03.823782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1175/2332] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:03 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:03.827996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:03.849214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:03.916416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a47d4-810e-46d6-ab91-e95e4dca65e0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:03.924543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6753f-9abf-4352-9631-4214c2c48a4a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:03.930339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:03.931109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:03.931551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:03.932117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:03.932834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:03.934837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:04.020168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:04.021351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:04.021834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:04.022258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:04.076149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1176/2333] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:03 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:34:04.082020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:04.094219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3585-1df8-4067-9a29-7dcafb6f31b2 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:04.095470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:04.097317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:04.100666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:04.101395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:04.101729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:04.102009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:04.102698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:04.104775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:04.111496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1158/2334] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:34:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:34:04.124371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1177/2335] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:04.129504 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:04.145657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468a79-8543-4e28-885d-2d88078d2143 service swift] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:04.152548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d52c8b-1b56-4031-954a-dab99a76c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:04.158224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52c8b-1b56-4031-954a-dab99a76c3ba admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:04.158224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52c8b-1b56-4031-954a-dab99a76c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:04.158224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52c8b-1b56-4031-954a-dab99a76c3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:04.158224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d52c8b-1b56-4031-954a-dab99a76c3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:04.158224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d52c8b-1b56-4031-954a-dab99a76c3ba admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:04.174223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1159/2336] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:34:04.175263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:04.204200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa70f3-d6e9-448d-87de-735e9ece1503 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:04.242903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:04.245300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:04.245996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:04.246658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] PATH_INFO: `/v3/projects/6cb82303913f467bba7569837ab12915/users/ec14e1377de5488eb246429c7111bb76/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:04.325722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb82303913f467bba7569837ab12915, user_id=ec14e1377de5488eb246429c7111bb76, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:04.328748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:04.535270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1178/2337] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:04 2022] PUT /identity/v3/projects/6cb82303913f467bba7569837ab12915/users/ec14e1377de5488eb246429c7111bb76/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:04.538775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5e3c-a494-4695-a881-a5a402633811 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:04.539344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5e3c-a494-4695-a881-a5a402633811 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:04.539344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5e3c-a494-4695-a881-a5a402633811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:04.639960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4d0e5e3c-a494-4695-a881-a5a402633811 None None] MFA Rules not processed for user `ec14e1377de5488eb246429c7111bb76`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:04.642647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4d0e5e3c-a494-4695-a881-a5a402633811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:04.803291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:04.823662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1160/2338] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:04.857265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:05.057485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3fe4a-e8bc-4e68-8cc7-d504b38a5899 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:05.084182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:05.085280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:05.085599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:05.085875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:05.086593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:05.088661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:05.329431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1179/2339] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:04 2022] POST /identity/v3/projects => generated 367 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:05.333406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e5e3c-a494-4695-a881-a5a402633811 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:05.354805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e5e3c-a494-4695-a881-a5a402633811 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:05.513894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:05.515039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:05.515695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:05.516491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:05.517472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:05.519745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:05.644893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1161/2340] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:05 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:34:05.654096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:05.685578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052670c-a05c-43e6-8232-3e1dee1d7a36 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:05.701602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:05.702864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:05.703236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:05.703502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:05.704217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:05.706141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:05.737523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1180/2341] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:05.741986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:05.758149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb151-32a0-4741-afac-ba868ed39d7f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:05.771558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:05.775361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:05.775640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:05.776517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] PATH_INFO: `/v3/projects/f36d171982d9402e8c2892010e7518c9/users/2c946a3617d642afa7d0aaee6471b332/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:05.819672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36d171982d9402e8c2892010e7518c9, user_id=2c946a3617d642afa7d0aaee6471b332, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:05.828912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:05.944604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1162/2342] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:05 2022] PUT /identity/v3/projects/f36d171982d9402e8c2892010e7518c9/users/2c946a3617d642afa7d0aaee6471b332/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:05.949064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:05.965634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e635a8-021f-46e8-a211-f1234c394e42 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:06.017811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:06.090355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e39b2e-bd14-4b3f-a5de-9c8835477b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:06.091014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39b2e-bd14-4b3f-a5de-9c8835477b46 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:06.091298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39b2e-bd14-4b3f-a5de-9c8835477b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:06.091574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39b2e-bd14-4b3f-a5de-9c8835477b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:06.092411 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e39b2e-bd14-4b3f-a5de-9c8835477b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:06.104276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e39b2e-bd14-4b3f-a5de-9c8835477b46 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:06.121642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1181/2343] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:34:06.126105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:06.145131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7f3ed-998e-4082-ad7b-e97a69dbf1f8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:06.153747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:06.155246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:06.155699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:06.157099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] PATH_INFO: `/v3/projects/f36d171982d9402e8c2892010e7518c9/users/2c946a3617d642afa7d0aaee6471b332/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:06.159788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36d171982d9402e8c2892010e7518c9, user_id=2c946a3617d642afa7d0aaee6471b332, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:06.163801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:06.182278 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1163/2344] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:06 2022] PUT /identity/v3/projects/f36d171982d9402e8c2892010e7518c9/users/2c946a3617d642afa7d0aaee6471b332/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:34:06.195931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:06.196803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:06.208770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:06.258478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] MFA Rules not processed for user `2c946a3617d642afa7d0aaee6471b332`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:06.261150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:06.419478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1182/2345] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:06.439883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:06.441971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:06.544197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be250f38-c876-4bd8-9d0e-dc656af48e2b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:06.550404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:06.551869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:06.551869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:06.552779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:06.577077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:06.579241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:06.595259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1164/2346] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:06.749747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:06.752609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:06.776420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b95faf-3ff3-4cfb-97b0-bafe2d04512b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:06.782728 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1f7ec-9427-48eb-8478-bcd11df44906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:06.783737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1f7ec-9427-48eb-8478-bcd11df44906 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:06.784381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1f7ec-9427-48eb-8478-bcd11df44906 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:06.785200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1f7ec-9427-48eb-8478-bcd11df44906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:06.891887 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1f7ec-9427-48eb-8478-bcd11df44906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:06.893935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1f7ec-9427-48eb-8478-bcd11df44906 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:06.932468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1183/2347] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:15.509504 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:15.612049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:15.631044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a319e-4075-40f1-adc4-b24eafb32532 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:15.645630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:15.647188 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:15.647780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:15.650972 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] PATH_INFO: `/v3/users/ec14e1377de5488eb246429c7111bb76` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:15.653970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec14e1377de5488eb246429c7111bb76)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:15.665211 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:16.137279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec14e1377de5488eb246429c7111bb76'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:16.353315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec14e1377de5488eb246429c7111bb76'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:16.355313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec14e1377de5488eb246429c7111bb76'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:16.398116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec14e1377de5488eb246429c7111bb76'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:16.408433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec14e1377de5488eb246429c7111bb76'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:16.427362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1165/2348] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:15 2022] DELETE /identity/v3/users/ec14e1377de5488eb246429c7111bb76 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:16.430162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:16.431440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:16.431440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:16.461964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:16.463946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:16.526246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:16.580806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1184/2349] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:34:16.590072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:16.592178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:16.700518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27959b7-1e8e-4d39-9aed-214bcc937e07 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:16.706180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:16.707074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:16.707422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:16.707706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:16.726872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:16.729425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:16.771924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1166/2350] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:17.603214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:17.605241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:17.628752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5fcf-c7b9-4290-93fb-c856d72519d1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:17.645453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:17.646419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:17.647059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:17.647297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] PATH_INFO: `/v3/projects/6cb82303913f467bba7569837ab12915` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:17.650048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb82303913f467bba7569837ab12915)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:17.656978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:18.522023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb82303913f467bba7569837ab12915', 'request_id': 'req-ffa23edb-c359-465f-aec7-f71f7d492672'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:18.528391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb82303913f467bba7569837ab12915', 'request_id': 'req-ffa23edb-c359-465f-aec7-f71f7d492672'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:18.534978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb82303913f467bba7569837ab12915', 'request_id': 'req-ffa23edb-c359-465f-aec7-f71f7d492672'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:18.879920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] The token cache is being invalidate because project 6cb82303913f467bba7569837ab12915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:18.880837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:18.881291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:18.883398 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1185/2351] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:17 2022] DELETE /identity/v3/projects/6cb82303913f467bba7569837ab12915 => generated 0 bytes in 1282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:18.888755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:18.901799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf5ea0-73d9-451d-a27f-17e3ac2b29ff service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:19.027347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:19.028059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:19.028263 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:19.028539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] PATH_INFO: `/v3/users/2c946a3617d642afa7d0aaee6471b332` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:19.030178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c946a3617d642afa7d0aaee6471b332)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:19.032311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:19.067149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:19.838249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c946a3617d642afa7d0aaee6471b332'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.113307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c946a3617d642afa7d0aaee6471b332'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.113922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c946a3617d642afa7d0aaee6471b332'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.132604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c946a3617d642afa7d0aaee6471b332'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.148024 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bb7f8633-c8d2-4bef-86a9-943bceea806c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c946a3617d642afa7d0aaee6471b332'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.166193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1167/2352] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:18 2022] DELETE /identity/v3/users/2c946a3617d642afa7d0aaee6471b332 => generated 0 bytes in 1268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:34:20.791312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:20.793683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:20.848667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa23edb-c359-465f-aec7-f71f7d492672 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:20.967915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:20.968657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:20.968970 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:20.969247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] PATH_INFO: `/v3/projects/f36d171982d9402e8c2892010e7518c9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:20.970370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f36d171982d9402e8c2892010e7518c9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:20.972295 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:21.223352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f36d171982d9402e8c2892010e7518c9', 'request_id': 'req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.238797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f36d171982d9402e8c2892010e7518c9', 'request_id': 'req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.250481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f36d171982d9402e8c2892010e7518c9', 'request_id': 'req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.256627 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:21.393857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] The token cache is being invalidate because project f36d171982d9402e8c2892010e7518c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:21.393857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.394162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-3186be5a-7ea5-49d6-b21c-b53f3de9b95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.395502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1186/2353] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:20 2022] DELETE /identity/v3/projects/f36d171982d9402e8c2892010e7518c9 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:21.401049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df504733-7d2d-479a-88bd-aa2697d3c0e8 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:21.401750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df504733-7d2d-479a-88bd-aa2697d3c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:21.401874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df504733-7d2d-479a-88bd-aa2697d3c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:21.428370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-df504733-7d2d-479a-88bd-aa2697d3c0e8 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:21.429634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-df504733-7d2d-479a-88bd-aa2697d3c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:21.494918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1168/2354] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:21.503256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711603-7f91-4617-b381-f701a7d147c1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:21.503538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711603-7f91-4617-b381-f701a7d147c1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:21.503817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711603-7f91-4617-b381-f701a7d147c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:21.526071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-38711603-7f91-4617-b381-f701a7d147c1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:21.527306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-38711603-7f91-4617-b381-f701a7d147c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:21.535313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1187/2355] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:34:21.539980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df504733-7d2d-479a-88bd-aa2697d3c0e8 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:21.550788 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df504733-7d2d-479a-88bd-aa2697d3c0e8 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:21.556537 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:21.557185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:21.557471 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:21.557742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:21.558400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:34:21.558699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:21.560299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:21.575512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1169/2356] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:34:21.580257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711603-7f91-4617-b381-f701a7d147c1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:21.590851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711603-7f91-4617-b381-f701a7d147c1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:21.595731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:21.596334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:21.596613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:21.596925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:21.597574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:21.599629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:21.770168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1188/2357] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:21 2022] POST /identity/v3/projects => generated 407 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:21.771980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:21.786670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a303f4-a69e-4299-9bfb-f0733b887292 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:21.855464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:21.856087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:21.856365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:21.856635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:21.857310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:21.859268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.049958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1170/2358] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:21 2022] POST /identity/v3/users => generated 304 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:22.054508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.065752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74656cef-6119-4756-ab95-2c7bebdef18c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.071416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.072220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.072506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.072818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.073480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.075193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.086813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1189/2359] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:22.094461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.105749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcc171-4ad7-4028-92c7-aae765044833 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.111651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c337be-2670-48be-a72d-85d378260248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.112259 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c337be-2670-48be-a72d-85d378260248 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.112540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c337be-2670-48be-a72d-85d378260248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.112910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c337be-2670-48be-a72d-85d378260248 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.113568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c337be-2670-48be-a72d-85d378260248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.115183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c337be-2670-48be-a72d-85d378260248 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.116692 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:22.127416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1171/2360] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:34:22.147389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.159170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993570b-552f-49fd-8613-711afd94d23f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.165292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.166121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.166416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.166707 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] PATH_INFO: `/v3/projects/d4843aa0b1954d51947679d9751cd9fb/users/a5d6e3cd5b354af482e4acd7da325e0f/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.183805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4843aa0b1954d51947679d9751cd9fb, user_id=a5d6e3cd5b354af482e4acd7da325e0f, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.186567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.385191 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1190/2361] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:22 2022] PUT /identity/v3/projects/d4843aa0b1954d51947679d9751cd9fb/users/a5d6e3cd5b354af482e4acd7da325e0f/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:34:22.397512 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c975-2e1d-44b7-8ec9-ebf0405d48aa None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.397796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c975-2e1d-44b7-8ec9-ebf0405d48aa None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.398072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c975-2e1d-44b7-8ec9-ebf0405d48aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.432895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e083c975-2e1d-44b7-8ec9-ebf0405d48aa None None] MFA Rules not processed for user `a5d6e3cd5b354af482e4acd7da325e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:22.434389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e083c975-2e1d-44b7-8ec9-ebf0405d48aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:22.506213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1172/2362] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:22.511273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.578372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc40f0-9c9e-42ed-b3b4-2c5dfe57fb4c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.583902 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.584523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.584830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.585101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.585796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.588585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.736976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1191/2363] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:22 2022] POST /identity/v3/projects => generated 409 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:22.741990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083c975-2e1d-44b7-8ec9-ebf0405d48aa None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.753551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083c975-2e1d-44b7-8ec9-ebf0405d48aa None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.817245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.821329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.821329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.821329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.821329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.821329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.965994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1173/2364] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:22 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:22.970116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.982725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad46d-738d-4f8a-8e0a-6bdd6b955089 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.987789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.988430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.988709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.989006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.989645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.991284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.002763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1192/2365] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:23.007157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:23.018066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03f31-5fa0-4cc0-8344-bb2b8fe88e65 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:23.024305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:23.025661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.025661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.025661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] PATH_INFO: `/v3/projects/b7fb837780c84a679f5fda5ac01db764/users/36de0a3877614f39a6e925c10c573568/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.047098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fb837780c84a679f5fda5ac01db764, user_id=36de0a3877614f39a6e925c10c573568, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:23.047319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.239609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1174/2366] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:23 2022] PUT /identity/v3/projects/b7fb837780c84a679f5fda5ac01db764/users/36de0a3877614f39a6e925c10c573568/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:23.245191 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:23.256258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aabeea-8f71-4d02-b6ce-e6149f9c4716 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:23.319413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044628ac-29e5-4659-8ff3-ff5a6e53bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:23.320215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044628ac-29e5-4659-8ff3-ff5a6e53bf10 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.320215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044628ac-29e5-4659-8ff3-ff5a6e53bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.321025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044628ac-29e5-4659-8ff3-ff5a6e53bf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.321952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044628ac-29e5-4659-8ff3-ff5a6e53bf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:23.323736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044628ac-29e5-4659-8ff3-ff5a6e53bf10 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.330074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:23.335555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1193/2367] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:23.340935 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:23.353422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19986-1211-4456-81a1-acb753d7b7fc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:23.361062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:23.361748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.362165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.362419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] PATH_INFO: `/v3/projects/b7fb837780c84a679f5fda5ac01db764/users/36de0a3877614f39a6e925c10c573568/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.364357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fb837780c84a679f5fda5ac01db764, user_id=36de0a3877614f39a6e925c10c573568, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:23.367129 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.379328 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1175/2368] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:23 2022] PUT /identity/v3/projects/b7fb837780c84a679f5fda5ac01db764/users/36de0a3877614f39a6e925c10c573568/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:23.393273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568707-219e-4f38-88dc-5219c0a3f80c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.393556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568707-219e-4f38-88dc-5219c0a3f80c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.394058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568707-219e-4f38-88dc-5219c0a3f80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.434045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-81568707-219e-4f38-88dc-5219c0a3f80c None None] MFA Rules not processed for user `36de0a3877614f39a6e925c10c573568`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:23.435319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-81568707-219e-4f38-88dc-5219c0a3f80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:23.527441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1194/2369] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:34:23.538627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:23.540800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:23.596040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:23.617879 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd5d3-c3cd-432b-8dab-8a767d53f833 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:23.621956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662dd5-3d51-40a4-b621-1f37cf201043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:23.622572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662dd5-3d51-40a4-b621-1f37cf201043 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.622854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662dd5-3d51-40a4-b621-1f37cf201043 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.623121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662dd5-3d51-40a4-b621-1f37cf201043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.633797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29662dd5-3d51-40a4-b621-1f37cf201043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:23.635279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29662dd5-3d51-40a4-b621-1f37cf201043 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.646424 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1176/2370] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:24.160568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81568707-219e-4f38-88dc-5219c0a3f80c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:24.170784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81568707-219e-4f38-88dc-5219c0a3f80c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:24.174591 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75daf99-1bb8-42fb-b94e-b6bc34dc83e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:24.175200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75daf99-1bb8-42fb-b94e-b6bc34dc83e6 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:24.175485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75daf99-1bb8-42fb-b94e-b6bc34dc83e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:24.175889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75daf99-1bb8-42fb-b94e-b6bc34dc83e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:24.249864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75daf99-1bb8-42fb-b94e-b6bc34dc83e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:24.250705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75daf99-1bb8-42fb-b94e-b6bc34dc83e6 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:24.263047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1195/2371] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:27.841195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcc15-ac41-42ca-a798-befa46de9aa8 None None] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:27.841828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcc15-ac41-42ca-a798-befa46de9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:27.841828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcc15-ac41-42ca-a798-befa46de9aa8 None None] PATH_INFO: `/` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:27.843071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1177/2372] 10.222.0.71 () {54 vars in 961 bytes} [Fri Sep 2 21:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:34:27.848470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00610194-ffc2-45ad-90b6-d79c140ba7ef None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:27.849021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00610194-ffc2-45ad-90b6-d79c140ba7ef None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:27.849117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00610194-ffc2-45ad-90b6-d79c140ba7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:27.924112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-00610194-ffc2-45ad-90b6-d79c140ba7ef None None] MFA Rules not processed for user `a3f84705571649b2bc20ec777e1e6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:27.925370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-00610194-ffc2-45ad-90b6-d79c140ba7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:27.986284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:28.011846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1196/2373] 10.222.0.71 () {58 vars in 1058 bytes} [Fri Sep 2 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:28.022397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bcc15-ac41-42ca-a798-befa46de9aa8 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:28.041358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bcc15-ac41-42ca-a798-befa46de9aa8 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:28.050311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:28.050931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:28.051203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:28.051469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:28.053245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:28.072796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:28.074598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:28.085749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1178/2374] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:31.630263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc276-32dc-4247-98c1-cc486e9d2562 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:31.630883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc276-32dc-4247-98c1-cc486e9d2562 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:31.630883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc276-32dc-4247-98c1-cc486e9d2562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:31.653622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c66cc276-32dc-4247-98c1-cc486e9d2562 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:31.655235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c66cc276-32dc-4247-98c1-cc486e9d2562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:31.733574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1197/2375] 10.222.0.71 () {58 vars in 967 bytes} [Fri Sep 2 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:31.747524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:31.749019 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:31.831284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b0336-20fc-4ea8-99e9-eace95b0bd0a service placement] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:31.839138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe57b10-c671-4ce6-bf2e-55052456f3fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:31.839682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57b10-c671-4ce6-bf2e-55052456f3fd service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:31.839851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57b10-c671-4ce6-bf2e-55052456f3fd service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:31.840426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57b10-c671-4ce6-bf2e-55052456f3fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:31.849469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe57b10-c671-4ce6-bf2e-55052456f3fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:31.850863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe57b10-c671-4ce6-bf2e-55052456f3fd service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:31.866621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1179/2376] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:34:34.325535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cc276-32dc-4247-98c1-cc486e9d2562 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:34.401962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cc276-32dc-4247-98c1-cc486e9d2562 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:34.407182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:34.409182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:34.409182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:34.409182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] PATH_INFO: `/v3/users/a5d6e3cd5b354af482e4acd7da325e0f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:34.409729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d6e3cd5b354af482e4acd7da325e0f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:34.411682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:34.759246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d6e3cd5b354af482e4acd7da325e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:34.761787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d6e3cd5b354af482e4acd7da325e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:34.924477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d6e3cd5b354af482e4acd7da325e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:34.925132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d6e3cd5b354af482e4acd7da325e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:34.933725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d6e3cd5b354af482e4acd7da325e0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:34.955925 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1198/2377] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:34 2022] DELETE /identity/v3/users/a5d6e3cd5b354af482e4acd7da325e0f => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:34.960371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:34.960981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:34.960981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:34.984215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:34.985526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.056533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1180/2378] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:35.070516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:35.072682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.093423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:35.146734 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f723c4-7192-4352-8093-bbe0b49bbb4d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:35.151551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:35.152172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:35.152454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:35.152762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:35.165137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:35.165409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:35.177360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1199/2379] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:35.913375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:35.913375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.929851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487db7b9-4958-434b-b95a-6ccfeec39699 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:35.945100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:35.953406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:35.953406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:35.953406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] PATH_INFO: `/v3/projects/d4843aa0b1954d51947679d9751cd9fb` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:35.953406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4843aa0b1954d51947679d9751cd9fb)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:35.953406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:36.170312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4843aa0b1954d51947679d9751cd9fb', 'request_id': 'req-d945e969-e11d-4a76-8927-69240a822090'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.174183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:36.179573 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4843aa0b1954d51947679d9751cd9fb', 'request_id': 'req-d945e969-e11d-4a76-8927-69240a822090'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.267266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4843aa0b1954d51947679d9751cd9fb', 'request_id': 'req-d945e969-e11d-4a76-8927-69240a822090'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.280354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] The token cache is being invalidate because project d4843aa0b1954d51947679d9751cd9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:36.280643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.281626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.283902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1181/2380] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:35 2022] DELETE /identity/v3/projects/d4843aa0b1954d51947679d9751cd9fb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:36.288353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:36.298402 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9174-edef-4752-9883-c6e175738256 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:36.368221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:36.369208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:36.369534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:36.369850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] PATH_INFO: `/v3/users/36de0a3877614f39a6e925c10c573568` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:36.371023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36de0a3877614f39a6e925c10c573568)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:36.373071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:36.680949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36de0a3877614f39a6e925c10c573568'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.683180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36de0a3877614f39a6e925c10c573568'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.795840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36de0a3877614f39a6e925c10c573568'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.796746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36de0a3877614f39a6e925c10c573568'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.807854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-02bb4808-5778-408f-9f34-b88255942bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36de0a3877614f39a6e925c10c573568'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:36.842571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1200/2381] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:36 2022] DELETE /identity/v3/users/36de0a3877614f39a6e925c10c573568 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:37.729661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:37.731469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:37.757831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e969-e11d-4a76-8927-69240a822090 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:37.916918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:37.917576 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:37.917857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:37.918123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] PATH_INFO: `/v3/projects/b7fb837780c84a679f5fda5ac01db764` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:37.919302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fb837780c84a679f5fda5ac01db764)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:37.921325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:38.125489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fb837780c84a679f5fda5ac01db764', 'request_id': 'req-d890f077-62be-497f-b2bb-b07a40a20239'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:38.135417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fb837780c84a679f5fda5ac01db764', 'request_id': 'req-d890f077-62be-497f-b2bb-b07a40a20239'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:38.250752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:38.251487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:38.251487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:38.276501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:38.276501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:38.314144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fb837780c84a679f5fda5ac01db764', 'request_id': 'req-d890f077-62be-497f-b2bb-b07a40a20239'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:38.320638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:38.329741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] The token cache is being invalidate because project b7fb837780c84a679f5fda5ac01db764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:38.330032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:38.330937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-d890f077-62be-497f-b2bb-b07a40a20239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:38.332952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1182/2382] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:37 2022] DELETE /identity/v3/projects/b7fb837780c84a679f5fda5ac01db764 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:38.338506 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4225c-4eb3-41f3-941a-24bc934e0ade None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:38.339299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4225c-4eb3-41f3-941a-24bc934e0ade None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:38.339812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4225c-4eb3-41f3-941a-24bc934e0ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:38.371061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0ed4225c-4eb3-41f3-941a-24bc934e0ade None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:38.373664 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0ed4225c-4eb3-41f3-941a-24bc934e0ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:38.414305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1201/2383] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:34:38.429646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:38.433145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:38.486654 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1183/2384] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:38.489185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd57a7-a0a9-497f-9cf3-bff4ea6c8877 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:38.489492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd57a7-a0a9-497f-9cf3-bff4ea6c8877 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:38.489767 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd57a7-a0a9-497f-9cf3-bff4ea6c8877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:38.543495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6fcd57a7-a0a9-497f-9cf3-bff4ea6c8877 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:38.546589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6fcd57a7-a0a9-497f-9cf3-bff4ea6c8877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:38.561980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1184/2385] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:38.567322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd57a7-a0a9-497f-9cf3-bff4ea6c8877 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:38.579494 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:38.598850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd57a7-a0a9-497f-9cf3-bff4ea6c8877 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:38.614157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:38.615313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:38.616968 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:38.621019 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd48b8-a586-4bef-a0b0-e5a5450f1b6f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:38.621483 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:38.624820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:34:38.624820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:38.624820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:38.636699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:38.637818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:38.649638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:38.649638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:38.649638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:38.650031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1185/2386] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:34:38.652279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:38.656906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:38.665205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1202/2387] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:34:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:34:38.690954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413827ac-4116-4530-9252-a508434343d7 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:38.717846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:38.723522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:38.723522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:38.723522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:38.723522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:38.723522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:38.943020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1186/2388] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:38 2022] POST /identity/v3/projects => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:38.948965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:38.974077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebb4dc-881f-47a4-9112-9d4f1311769f service swift] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:39.114972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:39.115849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:39.116179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:39.117520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:39.118478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:39.127740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:39.252535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1203/2389] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:38 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:39.257182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:39.275102 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a618d3-d2e9-415a-928f-25b15f4b9310 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:39.283311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:39.284243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:39.284519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:39.284820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:39.285749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:39.288137 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:39.306456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1187/2390] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:39.312374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:39.326450 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa6a77-c5e7-4e75-9486-b8d0b070080b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:39.336203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad08ea9-af4b-4cfb-9d26-79b3a845a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:39.337884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08ea9-af4b-4cfb-9d26-79b3a845a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:39.338537 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08ea9-af4b-4cfb-9d26-79b3a845a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:39.339190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08ea9-af4b-4cfb-9d26-79b3a845a5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:39.340139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad08ea9-af4b-4cfb-9d26-79b3a845a5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:39.342470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad08ea9-af4b-4cfb-9d26-79b3a845a5cf admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:39.362706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:39.363642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1204/2391] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:34:39.376861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091465b-4f03-475a-90c6-fd0ed007c3ef admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:39.386545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:39.387248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:39.387508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:39.387875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] PATH_INFO: `/v3/projects/f9bd1f852abd451cb21e53ec076609fc/users/e7ac49649ad14c42895515f9eb6b4570/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:39.415250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bd1f852abd451cb21e53ec076609fc, user_id=e7ac49649ad14c42895515f9eb6b4570, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:39.418404 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:39.519427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1188/2392] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:39 2022] PUT /identity/v3/projects/f9bd1f852abd451cb21e53ec076609fc/users/e7ac49649ad14c42895515f9eb6b4570/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:39.602662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f703a6-2278-49b9-b182-0d8047d03038 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:39.603070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f703a6-2278-49b9-b182-0d8047d03038 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:39.603294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f703a6-2278-49b9-b182-0d8047d03038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:39.636052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-82f703a6-2278-49b9-b182-0d8047d03038 None None] MFA Rules not processed for user `e7ac49649ad14c42895515f9eb6b4570`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:39.639614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-82f703a6-2278-49b9-b182-0d8047d03038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:39.746095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1205/2393] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:39.750833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:39.832081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec4c43-61b8-4ccc-be4d-599fa574e116 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:39.838870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:39.839259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:39.839497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:39.839777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:39.840055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:39.840841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:39.843087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:39.976595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1189/2394] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:39 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:34:39.981406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f703a6-2278-49b9-b182-0d8047d03038 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:39.993144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f703a6-2278-49b9-b182-0d8047d03038 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:40.067252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:40.070078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.070384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.070718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.071542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:40.076427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:40.191172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1206/2395] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:39 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:34:40.192553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:40.204511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f4bf5-61ab-4a6e-a4a5-4f5d9175daa1 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:40.209673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:40.211887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.211887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.211887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.211887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:40.213460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:40.225461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1190/2396] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:40.230209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:40.241146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9a9bd-e93e-407d-bd44-6d94525220bb admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:40.247079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:40.247786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.248064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.248430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] PATH_INFO: `/v3/projects/f1ec18fbd0574ca88629d62c6240a228/users/b0662c6d6fa04865ab291c2ec35ec1b9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.271913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ec18fbd0574ca88629d62c6240a228, user_id=b0662c6d6fa04865ab291c2ec35ec1b9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:40.275926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:40.370566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1207/2397] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:40 2022] PUT /identity/v3/projects/f1ec18fbd0574ca88629d62c6240a228/users/b0662c6d6fa04865ab291c2ec35ec1b9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:40.374610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:40.386253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5304ec-feae-4166-8665-4d4f95df98f5 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:40.466602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b4c4-c828-432c-a196-1e16fbd5ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:40.467305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b4c4-c828-432c-a196-1e16fbd5ee70 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.473721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b4c4-c828-432c-a196-1e16fbd5ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.473721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b4c4-c828-432c-a196-1e16fbd5ee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.473721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b4c4-c828-432c-a196-1e16fbd5ee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:40.473721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b4c4-c828-432c-a196-1e16fbd5ee70 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:40.499684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1191/2398] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:40.501129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:40.512678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb432-8db6-40d9-811b-02a6fc010508 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:40.517712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:40.518493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.518956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.519235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] PATH_INFO: `/v3/projects/f1ec18fbd0574ca88629d62c6240a228/users/b0662c6d6fa04865ab291c2ec35ec1b9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.521422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ec18fbd0574ca88629d62c6240a228, user_id=b0662c6d6fa04865ab291c2ec35ec1b9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:40.524480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:40.536269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1208/2399] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:40 2022] PUT /identity/v3/projects/f1ec18fbd0574ca88629d62c6240a228/users/b0662c6d6fa04865ab291c2ec35ec1b9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:40.548026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2b60e-efd5-4dee-9914-b8449ede12bc None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.548305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2b60e-efd5-4dee-9914-b8449ede12bc None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.548592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2b60e-efd5-4dee-9914-b8449ede12bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.558301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:40.582235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-e6c2b60e-efd5-4dee-9914-b8449ede12bc None None] MFA Rules not processed for user `b0662c6d6fa04865ab291c2ec35ec1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:40.583629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e6c2b60e-efd5-4dee-9914-b8449ede12bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:40.669208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1192/2400] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:40.681278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:40.683242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:40.749589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf65127-6ac9-47a7-a274-9fbae2a8b153 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:40.753408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:40.754039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.754301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.759385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.766338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:40.767852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:40.779520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1209/2401] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:41.117850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2b60e-efd5-4dee-9914-b8449ede12bc None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:41.131885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2b60e-efd5-4dee-9914-b8449ede12bc None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:41.144043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:41.144043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:41.144043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:41.144043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:41.218034 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:41.219532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:41.230021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1193/2402] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:34:44.542377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:44.546048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:44.651161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:44.730956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c60c7-5fac-4d41-a52e-4e0492bd172a service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:44.742203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:44.745843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:44.745843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:44.746358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] PATH_INFO: `/v3/users/c0f4034fddec4b9d91ad1c2868a0da54` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:44.749851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f4034fddec4b9d91ad1c2868a0da54)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:44.754138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:45.178161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f4034fddec4b9d91ad1c2868a0da54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:45.179589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f4034fddec4b9d91ad1c2868a0da54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:45.310555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f4034fddec4b9d91ad1c2868a0da54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:45.311583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f4034fddec4b9d91ad1c2868a0da54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:45.321269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f4034fddec4b9d91ad1c2868a0da54'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:45.362477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1210/2403] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:44 2022] DELETE /identity/v3/users/c0f4034fddec4b9d91ad1c2868a0da54 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:45.768100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:45.789919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce79c15-ee63-42ca-a80a-42d2aeb2a2de service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:45.887119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:45.887963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:45.889182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:45.889569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] PATH_INFO: `/v3/projects/46ad9f37c29c4093a97d0687a4e2793b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:45.890995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ad9f37c29c4093a97d0687a4e2793b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:45.893451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:46.148000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:46.191004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ad9f37c29c4093a97d0687a4e2793b', 'request_id': 'req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:46.211871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ad9f37c29c4093a97d0687a4e2793b', 'request_id': 'req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:46.354624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ad9f37c29c4093a97d0687a4e2793b', 'request_id': 'req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:46.418127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] The token cache is being invalidate because project 46ad9f37c29c4093a97d0687a4e2793b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:46.418491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:46.424854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:46.461009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1194/2404] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:45 2022] DELETE /identity/v3/projects/46ad9f37c29c4093a97d0687a4e2793b => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:46.469294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:46.471103 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:46.509197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01cf99-a45a-405a-9662-f429026d5d7f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:46.621532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:46.622407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:46.622893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:46.623279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] PATH_INFO: `/v3/users/ff4386d6c84c42e5b343d54af4c2c15a` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:46.624835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4386d6c84c42e5b343d54af4c2c15a)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:46.626896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:46.917915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4386d6c84c42e5b343d54af4c2c15a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:46.918762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4386d6c84c42e5b343d54af4c2c15a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:46.926355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:47.003297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4386d6c84c42e5b343d54af4c2c15a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:47.003919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4386d6c84c42e5b343d54af4c2c15a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:47.011879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4386d6c84c42e5b343d54af4c2c15a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:47.033330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1211/2405] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:46 2022] DELETE /identity/v3/users/ff4386d6c84c42e5b343d54af4c2c15a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:47.775183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:47.775183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:47.811476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799ca8b-33a1-4d2f-8dc6-3dadeecaa31c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:47.991709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:47.993376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:47.993869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:47.995435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] PATH_INFO: `/v3/projects/53eaa26998bd45c2a50cc8199f5cb442` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:47.998000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53eaa26998bd45c2a50cc8199f5cb442)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:48.001837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:48.131362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53eaa26998bd45c2a50cc8199f5cb442', 'request_id': 'req-1d9367c4-8e12-4ee8-8906-5776cf6a6936'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:48.138132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53eaa26998bd45c2a50cc8199f5cb442', 'request_id': 'req-1d9367c4-8e12-4ee8-8906-5776cf6a6936'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:48.203916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53eaa26998bd45c2a50cc8199f5cb442', 'request_id': 'req-1d9367c4-8e12-4ee8-8906-5776cf6a6936'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:48.217653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] The token cache is being invalidate because project 53eaa26998bd45c2a50cc8199f5cb442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:48.217946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:48.218604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-1d9367c4-8e12-4ee8-8906-5776cf6a6936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:48.220175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1195/2406] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:47 2022] DELETE /identity/v3/projects/53eaa26998bd45c2a50cc8199f5cb442 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:50.638137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:50.639743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:50.653466 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3ea5-c5f3-4d20-ae7a-d2da57c08311 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:50.727956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:50.728672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:50.729172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:50.729461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] PATH_INFO: `/v3/users/e7ac49649ad14c42895515f9eb6b4570` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:50.730723 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ac49649ad14c42895515f9eb6b4570)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:50.734580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:50.974220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ac49649ad14c42895515f9eb6b4570'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:50.977509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ac49649ad14c42895515f9eb6b4570'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:51.066637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ac49649ad14c42895515f9eb6b4570'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:51.067282 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ac49649ad14c42895515f9eb6b4570'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:51.076506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ac49649ad14c42895515f9eb6b4570'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:51.098478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1212/2407] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:50 2022] DELETE /identity/v3/users/e7ac49649ad14c42895515f9eb6b4570 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:51.103402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:51.103910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:51.104025 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:51.131943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:51.134490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:51.208009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:51.231808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1196/2408] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:51.242571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:51.244505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:51.325171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:51.334371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56b1e-c43f-4e8e-8305-2dfe08d2ca91 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:51.340691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:51.341018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:51.341195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:51.341475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:51.352668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:51.354145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:51.365725 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1213/2409] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:53.112342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:53.114029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:53.130992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c861891-66fb-405f-b53d-6799c2331412 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:53.137942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:53.149467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:53.149467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:53.149467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] PATH_INFO: `/v3/projects/f9bd1f852abd451cb21e53ec076609fc` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:53.149467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9bd1f852abd451cb21e53ec076609fc)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:53.149467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:53.365720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9bd1f852abd451cb21e53ec076609fc', 'request_id': 'req-9e400c6f-7290-4287-bdaa-cac2e29cdd67'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:53.374857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9bd1f852abd451cb21e53ec076609fc', 'request_id': 'req-9e400c6f-7290-4287-bdaa-cac2e29cdd67'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:53.443762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9bd1f852abd451cb21e53ec076609fc', 'request_id': 'req-9e400c6f-7290-4287-bdaa-cac2e29cdd67'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:53.459865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] The token cache is being invalidate because project f9bd1f852abd451cb21e53ec076609fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:53.460550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:53.462373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:53.465602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1197/2410] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:53 2022] DELETE /identity/v3/projects/f9bd1f852abd451cb21e53ec076609fc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:53.469972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:53.482302 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566b57-407e-4a41-a6bb-d7d9cf05206e service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:53.581527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:53.581527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:53.581527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:53.581527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] PATH_INFO: `/v3/users/b0662c6d6fa04865ab291c2ec35ec1b9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:53.582485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0662c6d6fa04865ab291c2ec35ec1b9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:53.583432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:53.885732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0662c6d6fa04865ab291c2ec35ec1b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:53.886710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0662c6d6fa04865ab291c2ec35ec1b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:54.038531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0662c6d6fa04865ab291c2ec35ec1b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:54.039559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0662c6d6fa04865ab291c2ec35ec1b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:54.048573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ec863159-f27e-49f3-86d1-6320a280daf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0662c6d6fa04865ab291c2ec35ec1b9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:54.066979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1214/2411] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:53 2022] DELETE /identity/v3/users/b0662c6d6fa04865ab291c2ec35ec1b9 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:34:54.681135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:54.684057 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:54.696497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400c6f-7290-4287-bdaa-cac2e29cdd67 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:54.801017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:54.801719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:54.802002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:54.803295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] PATH_INFO: `/v3/projects/f1ec18fbd0574ca88629d62c6240a228` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:54.803616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ec18fbd0574ca88629d62c6240a228)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:54.806427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:54.947445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ec18fbd0574ca88629d62c6240a228', 'request_id': 'req-bd892625-9241-48f7-bfdb-a1e5cbb9308c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:54.953777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ec18fbd0574ca88629d62c6240a228', 'request_id': 'req-bd892625-9241-48f7-bfdb-a1e5cbb9308c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:55.111833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ec18fbd0574ca88629d62c6240a228', 'request_id': 'req-bd892625-9241-48f7-bfdb-a1e5cbb9308c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:55.125020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] The token cache is being invalidate because project f1ec18fbd0574ca88629d62c6240a228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:55.125343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:55.125997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bd892625-9241-48f7-bfdb-a1e5cbb9308c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:55.127461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1198/2412] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:54 2022] DELETE /identity/v3/projects/f1ec18fbd0574ca88629d62c6240a228 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:55.132587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d2f02-88bb-4389-b5ed-b17143f97015 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.133221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d2f02-88bb-4389-b5ed-b17143f97015 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.133581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d2f02-88bb-4389-b5ed-b17143f97015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.155769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e00d2f02-88bb-4389-b5ed-b17143f97015 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:55.157066 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e00d2f02-88bb-4389-b5ed-b17143f97015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:55.225921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1215/2413] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:55.236144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4be45-8d30-41a9-bb3d-3a939feacb6e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.236466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4be45-8d30-41a9-bb3d-3a939feacb6e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.236996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4be45-8d30-41a9-bb3d-3a939feacb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.246143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:55.262718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-30a4be45-8d30-41a9-bb3d-3a939feacb6e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:55.265238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-30a4be45-8d30-41a9-bb3d-3a939feacb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:55.277601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1199/2414] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:55.284329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d2f02-88bb-4389-b5ed-b17143f97015 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:55.299766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d2f02-88bb-4389-b5ed-b17143f97015 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:55.305420 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:55.306055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.306340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.306617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.307281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:34:55.307620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:55.309421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:55.316888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:55.323655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1216/2415] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:34:55.327897 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4be45-8d30-41a9-bb3d-3a939feacb6e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:55.338688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4be45-8d30-41a9-bb3d-3a939feacb6e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:55.343621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:55.344228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.344532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.344840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.345478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:55.347429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:55.520373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1200/2416] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:55 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:55.533601 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:55.548200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bbfbf-c0cb-4f79-a4d0-4f26fd66cf4f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:55.654396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:55.655796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.657115 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.657603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.658940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:55.663129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:55.819051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1217/2417] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:55 2022] POST /identity/v3/users => generated 287 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:55.825098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:55.837741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6664c-11fc-4e2a-9bea-32a1dba46078 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:55.847082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:55.848143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.848642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.849154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.850549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:55.856804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:55.874559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1201/2418] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:55.880046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:55.893511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41326-fbf3-46cc-8e6b-abf48185cf49 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:55.900089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b52f7-89b2-426b-87ef-4ec132471f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:55.900614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b52f7-89b2-426b-87ef-4ec132471f84 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.901015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b52f7-89b2-426b-87ef-4ec132471f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.901434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b52f7-89b2-426b-87ef-4ec132471f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.902091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b52f7-89b2-426b-87ef-4ec132471f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:55.903722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b52f7-89b2-426b-87ef-4ec132471f84 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:55.916590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1218/2419] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:55.922388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:55.933827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dc78a-04d1-4279-bd6a-af4cad67e7a7 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:55.940400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:55.941224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:55.941574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:55.941920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] PATH_INFO: `/v3/projects/71182b7ab01a4591b9187a31345bc1f4/users/af6b0e2ea8284f7c80a1f138dc2ff4cc/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:55.962002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71182b7ab01a4591b9187a31345bc1f4, user_id=af6b0e2ea8284f7c80a1f138dc2ff4cc, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:55.964981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:56.067516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1202/2420] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:55 2022] PUT /identity/v3/projects/71182b7ab01a4591b9187a31345bc1f4/users/af6b0e2ea8284f7c80a1f138dc2ff4cc/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:56.073464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57813049-3a33-4311-92d1-4019ca20ec7d None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:56.073747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57813049-3a33-4311-92d1-4019ca20ec7d None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:56.074075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57813049-3a33-4311-92d1-4019ca20ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:56.094190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-57813049-3a33-4311-92d1-4019ca20ec7d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:56.095385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-57813049-3a33-4311-92d1-4019ca20ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:56.168421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1219/2421] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:34:56.181112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:56.185378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:56.254487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70606c8-a78c-4885-9f97-08a8578fd58f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:56.259338 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:56.260395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:56.260937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:56.261424 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:56.271688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:56.273282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:56.284567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1203/2422] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:57.947000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826edac-a5dc-43c6-bb97-f476384dadb3 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:57.947504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826edac-a5dc-43c6-bb97-f476384dadb3 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:57.951777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826edac-a5dc-43c6-bb97-f476384dadb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:57.992923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0826edac-a5dc-43c6-bb97-f476384dadb3 None None] MFA Rules not processed for user `af6b0e2ea8284f7c80a1f138dc2ff4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:57.994258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0826edac-a5dc-43c6-bb97-f476384dadb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:58.075105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1220/2423] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:58.087796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:58.089459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:58.166672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445253-ecf1-402a-9dcc-cb343aaee42d service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:58.170583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:58.171197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:58.171499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:58.171752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:58.182606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:58.185556 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:58.198074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1204/2424] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:59.609038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640734-beb1-4f06-8b6d-9256abd421ee None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:59.609561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640734-beb1-4f06-8b6d-9256abd421ee None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:59.609672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640734-beb1-4f06-8b6d-9256abd421ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:59.625088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:59.636566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1d640734-beb1-4f06-8b6d-9256abd421ee None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:59.638333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1d640734-beb1-4f06-8b6d-9256abd421ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:59.745193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1221/2425] 10.222.0.71 () {58 vars in 967 bytes} [Fri Sep 2 21:34:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:34:59.764292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:59.765743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:59.824237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:59.848640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea591e-6e49-451f-8a65-fbc4d80952aa service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:59.853870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:59.854701 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:59.855302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:59.855642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:59.867907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:59.869768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:59.878623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1205/2426] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 02 21:35:01.201663 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:01.202213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:01.202313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:01.223717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] MFA Rules not processed for user `af6b0e2ea8284f7c80a1f138dc2ff4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:01.225356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:01.232681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1222/2427] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:03.483657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:03.485566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:03.499576 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb7395-a829-4f38-b292-359b48fd7520 service swift] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:03.503711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:03.504386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:03.504709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:03.508242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:03.508242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:03.532118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:03.536643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:03.544425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1206/2428] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:35:08.517533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:08.519073 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:08.537074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2579a5-6645-4b78-90b6-5209dc15015f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:08.542629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:08.543289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:08.543561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:08.544032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] PATH_INFO: `/v3/users/e43f913fbce54697b3261efc93ad9e12` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:08.545335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43f913fbce54697b3261efc93ad9e12)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:08.547324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:08.820967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43f913fbce54697b3261efc93ad9e12'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:08.821807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43f913fbce54697b3261efc93ad9e12'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:08.923814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43f913fbce54697b3261efc93ad9e12'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:08.924822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43f913fbce54697b3261efc93ad9e12'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:08.935243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2eff2561-40c5-4779-aa86-ba6fe15d9e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43f913fbce54697b3261efc93ad9e12'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:08.967479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1223/2429] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:35:08 2022] DELETE /identity/v3/users/e43f913fbce54697b3261efc93ad9e12 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:35:09.428855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:09.446543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a2f8d-4f51-4af8-be6b-54a3a9d95f25 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:09.522515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:09.523570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:09.524203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:09.525091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] PATH_INFO: `/v3/projects/0b6f0f2a7ea249e4bc8ae87f25b088a0` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:09.526324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6f0f2a7ea249e4bc8ae87f25b088a0)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:09.528336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:09.708329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6f0f2a7ea249e4bc8ae87f25b088a0', 'request_id': 'req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:09.716080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6f0f2a7ea249e4bc8ae87f25b088a0', 'request_id': 'req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:09.866142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6f0f2a7ea249e4bc8ae87f25b088a0', 'request_id': 'req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:09.882837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] The token cache is being invalidate because project 0b6f0f2a7ea249e4bc8ae87f25b088a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:35:09.883124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:09.884162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-43afb62d-9cc2-4da2-8fd2-ec3a52231c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:09.886677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1207/2430] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:35:09 2022] DELETE /identity/v3/projects/0b6f0f2a7ea249e4bc8ae87f25b088a0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:09.893056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a26ce-cb91-474d-8abc-c1cba061840a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:09.893649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a26ce-cb91-474d-8abc-c1cba061840a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:09.893649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a26ce-cb91-474d-8abc-c1cba061840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:09.915713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-265a26ce-cb91-474d-8abc-c1cba061840a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:09.916974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-265a26ce-cb91-474d-8abc-c1cba061840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:09.993939 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1224/2431] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:10.004907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cd34a-c6fe-47af-90b3-d4ca11626589 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.005280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cd34a-c6fe-47af-90b3-d4ca11626589 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.005566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cd34a-c6fe-47af-90b3-d4ca11626589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.028334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f51cd34a-c6fe-47af-90b3-d4ca11626589 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:10.029617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f51cd34a-c6fe-47af-90b3-d4ca11626589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:10.040119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1208/2432] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:10.044671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a26ce-cb91-474d-8abc-c1cba061840a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:10.055987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a26ce-cb91-474d-8abc-c1cba061840a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:10.061139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:10.061754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.062037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.062311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.062966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:35:10.063298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:10.065146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:10.079512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1225/2433] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:35:10.084578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cd34a-c6fe-47af-90b3-d4ca11626589 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:10.095106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cd34a-c6fe-47af-90b3-d4ca11626589 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:10.105999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:10.106632 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.106906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.107215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.107842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:10.109836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:10.256365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1209/2434] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:35:10 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:35:10.261531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:10.269487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:10.274788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63369a4d-bc92-43ee-bba3-17940456430f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:10.362938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:10.363563 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.363842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.365606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.365606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:10.368156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:10.539252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1226/2435] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:35:10 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:35:10.542314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:10.554339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aab30-1704-41c8-a624-eb9ce47e4c7b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:10.565625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:10.566402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.566777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.567270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.568061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:10.570518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:10.595923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1210/2436] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:35:10.600714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:10.616816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5ffa4-ee88-428d-91c5-ef4f5a8a5b22 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:10.625037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99eb26-3241-44ed-81d1-73dfa2491d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:10.625037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99eb26-3241-44ed-81d1-73dfa2491d54 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.625037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99eb26-3241-44ed-81d1-73dfa2491d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.625037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99eb26-3241-44ed-81d1-73dfa2491d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.626128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99eb26-3241-44ed-81d1-73dfa2491d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:10.627181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99eb26-3241-44ed-81d1-73dfa2491d54 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:10.652255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1227/2437] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:35:10.653973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:10.665986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889084dc-35ee-4ba1-a1da-ee3453af8e9c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:10.671898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:10.672558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.672869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.673145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] PATH_INFO: `/v3/projects/df86a5ddbd414e7ebe29ce40d3804790/users/a780135a7e6b464a8cb48d7e39e96e80/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.682811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:10.690476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=df86a5ddbd414e7ebe29ce40d3804790, user_id=a780135a7e6b464a8cb48d7e39e96e80, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:10.702309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:10.809561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1211/2438] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:35:10 2022] PUT /identity/v3/projects/df86a5ddbd414e7ebe29ce40d3804790/users/a780135a7e6b464a8cb48d7e39e96e80/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:10.822699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e190609-43ae-4132-8400-ee4da8605339 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:10.822996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e190609-43ae-4132-8400-ee4da8605339 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:10.823252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e190609-43ae-4132-8400-ee4da8605339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:10.869770 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9e190609-43ae-4132-8400-ee4da8605339 None None] MFA Rules not processed for user `a780135a7e6b464a8cb48d7e39e96e80`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:10.871674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9e190609-43ae-4132-8400-ee4da8605339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:10.959560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1228/2439] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:10.965051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:11.047112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d03a9-f44b-4ff9-8a14-21510f2252ec admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:11.054795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:11.055732 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:11.057621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:11.057621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:11.057621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:11.058978 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:11.179615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1212/2440] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:35:10 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:35:11.184903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e190609-43ae-4132-8400-ee4da8605339 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:11.199778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e190609-43ae-4132-8400-ee4da8605339 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:11.292483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:11.293130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:11.293412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:11.298901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:11.298901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:11.298901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:11.448361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1229/2441] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:35:11 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:35:11.452829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:11.466756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2dd0-e8d2-45e5-a4f4-9eba5f70f321 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:11.471981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:11.472868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:11.472868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:11.473179 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:11.473869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:11.475688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:11.488266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1213/2442] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:35:11.494613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:11.500645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:11.506772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163dc3-5cd6-4ee1-8f8f-d5a1f0878009 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:11.523026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:11.524148 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:11.524756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:11.525298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] PATH_INFO: `/v3/projects/beaa4d4efcf843d68d58ac66be2bd49d/users/3193bd0b7f2f4861951e1dd03a094306/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:11.545482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=beaa4d4efcf843d68d58ac66be2bd49d, user_id=3193bd0b7f2f4861951e1dd03a094306, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:11.548165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:11.700233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1230/2443] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:35:11 2022] PUT /identity/v3/projects/beaa4d4efcf843d68d58ac66be2bd49d/users/3193bd0b7f2f4861951e1dd03a094306/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:11.703194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:11.719762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14577-fd62-4d81-8902-2ff9dca213a7 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:11.816684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16530b2-9079-4fb4-8427-5e9cb4a1f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:11.817363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16530b2-9079-4fb4-8427-5e9cb4a1f83f admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:11.817639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16530b2-9079-4fb4-8427-5e9cb4a1f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:11.817905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16530b2-9079-4fb4-8427-5e9cb4a1f83f admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:11.818554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16530b2-9079-4fb4-8427-5e9cb4a1f83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:11.820965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16530b2-9079-4fb4-8427-5e9cb4a1f83f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:11.833758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1214/2444] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:35:11.838637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:11.849243 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10f07c-5215-4d65-a4f0-30d0821ee8af admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:11.856099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:11.856798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:11.857082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:11.857364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] PATH_INFO: `/v3/projects/beaa4d4efcf843d68d58ac66be2bd49d/users/3193bd0b7f2f4861951e1dd03a094306/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:11.859684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=beaa4d4efcf843d68d58ac66be2bd49d, user_id=3193bd0b7f2f4861951e1dd03a094306, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:11.862536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:11.874666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1231/2445] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:35:11 2022] PUT /identity/v3/projects/beaa4d4efcf843d68d58ac66be2bd49d/users/3193bd0b7f2f4861951e1dd03a094306/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:11.886320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bcb6e-9625-4e9e-80fe-b6e03e6b3504 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:11.886619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bcb6e-9625-4e9e-80fe-b6e03e6b3504 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:11.886998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bcb6e-9625-4e9e-80fe-b6e03e6b3504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:11.926318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-274bcb6e-9625-4e9e-80fe-b6e03e6b3504 None None] MFA Rules not processed for user `3193bd0b7f2f4861951e1dd03a094306`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:11.928402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-274bcb6e-9625-4e9e-80fe-b6e03e6b3504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:12.002105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:12.033196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1215/2446] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:12.049492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:12.052083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:12.125905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06761-b1e7-4e82-b5b1-8093a370f9ba admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:12.129720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa323e-556a-4218-87f6-ff8842cdb7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:12.130334 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa323e-556a-4218-87f6-ff8842cdb7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:12.130639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa323e-556a-4218-87f6-ff8842cdb7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:12.130886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa323e-556a-4218-87f6-ff8842cdb7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:12.142463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa323e-556a-4218-87f6-ff8842cdb7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:12.143966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa323e-556a-4218-87f6-ff8842cdb7b0 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:12.155577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1232/2447] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:12.542336 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bcb6e-9625-4e9e-80fe-b6e03e6b3504 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:12.552295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bcb6e-9625-4e9e-80fe-b6e03e6b3504 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:12.555933 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:12.556540 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:12.556869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:12.557127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:12.620922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:12.622417 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:12.632643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1216/2448] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:23.037551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=40,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:23.311690 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=36 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:27.000128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:27.000635 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:27.000750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:27.021850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] MFA Rules not processed for user `af6b0e2ea8284f7c80a1f138dc2ff4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:27.023013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:27.105611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1233/2449] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:34.963615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:34.965269 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:35.033252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68c488-8c62-4fc1-be3c-73c3ab275461 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:35.037986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:35.038599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:35.038913 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:35.039214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:35.041160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:35.139724 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:35.141241 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:35.152277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1217/2450] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:37.098239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=25 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:39.865596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:39.867111 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:39.894570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e76c-244f-4b6e-ab78-5867e796d5c6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:39.907335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:39.907997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:39.908419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:39.908694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] PATH_INFO: `/v3/users/e4ee406036b54e8f862cbcc942fc985b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:39.910283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ee406036b54e8f862cbcc942fc985b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:39.912226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:40.355594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ee406036b54e8f862cbcc942fc985b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:40.357233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ee406036b54e8f862cbcc942fc985b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:40.448653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ee406036b54e8f862cbcc942fc985b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:40.449445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ee406036b54e8f862cbcc942fc985b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:40.459561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-ac83a00a-a502-49f8-812c-1c2b77e284c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ee406036b54e8f862cbcc942fc985b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:40.481585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1234/2451] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:35:39 2022] DELETE /identity/v3/users/e4ee406036b54e8f862cbcc942fc985b => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:40.780855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:40.794360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8f84-a5ff-4213-b939-3ad641ac6920 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:40.864207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:40.864964 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:40.865322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:40.865571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] PATH_INFO: `/v3/projects/fd2d953f062345ea90c4f07323bf89be` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:40.866670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2d953f062345ea90c4f07323bf89be)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:40.868587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:40.982587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2d953f062345ea90c4f07323bf89be', 'request_id': 'req-684e7c8d-cff8-419d-955a-5c4e0db418f7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:40.985657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:40.990612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2d953f062345ea90c4f07323bf89be', 'request_id': 'req-684e7c8d-cff8-419d-955a-5c4e0db418f7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:41.077718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2d953f062345ea90c4f07323bf89be', 'request_id': 'req-684e7c8d-cff8-419d-955a-5c4e0db418f7'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:41.089600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] The token cache is being invalidate because project fd2d953f062345ea90c4f07323bf89be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:35:41.089892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:41.091192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-684e7c8d-cff8-419d-955a-5c4e0db418f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:41.092894 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1218/2452] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:35:40 2022] DELETE /identity/v3/projects/fd2d953f062345ea90c4f07323bf89be => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:41.099724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25def935-e7a8-4f1c-81ae-580bb548cd69 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.100256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25def935-e7a8-4f1c-81ae-580bb548cd69 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.100671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25def935-e7a8-4f1c-81ae-580bb548cd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.133699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-25def935-e7a8-4f1c-81ae-580bb548cd69 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:41.134933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-25def935-e7a8-4f1c-81ae-580bb548cd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:41.202480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1235/2453] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:41.213064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73a011-b056-4bdb-adac-7c1c308be868 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.213349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73a011-b056-4bdb-adac-7c1c308be868 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.213627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73a011-b056-4bdb-adac-7c1c308be868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.236175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4b73a011-b056-4bdb-adac-7c1c308be868 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:41.239066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4b73a011-b056-4bdb-adac-7c1c308be868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:41.248023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1219/2454] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:41.252708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25def935-e7a8-4f1c-81ae-580bb548cd69 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:41.263966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25def935-e7a8-4f1c-81ae-580bb548cd69 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:41.268903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:41.269473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.269754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.270027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.270682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:35:41.270984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:41.272652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:41.286361 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1236/2455] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:35:41.291639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73a011-b056-4bdb-adac-7c1c308be868 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:41.307225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73a011-b056-4bdb-adac-7c1c308be868 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:41.313118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:41.313742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.314022 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.314297 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.314950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:41.316910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:41.442138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1220/2456] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:35:41 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:35:41.446268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:41.457577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d887865-232f-4b1f-933e-b6711bb8b38a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:41.547258 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:41.548080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.548543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.548953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.549776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:41.552321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:41.562109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:41.690520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1237/2457] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:35:41 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:35:41.694989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:41.709270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c130-dee3-4f9f-85b3-9b90e62c6d5d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:41.715067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:41.716437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.716437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.717231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.717876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:41.723341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:41.738999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1221/2458] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:35:41.743056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:41.756584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60de9a-f214-435c-a0bf-1bf396d8134b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:41.761830 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d9608-e902-44e7-b41e-fc7f99450987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:41.762682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d9608-e902-44e7-b41e-fc7f99450987 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.763165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d9608-e902-44e7-b41e-fc7f99450987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.763606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d9608-e902-44e7-b41e-fc7f99450987 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.764512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d9608-e902-44e7-b41e-fc7f99450987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:41.765913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d9608-e902-44e7-b41e-fc7f99450987 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:41.779387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1238/2459] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:35:41.783761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:41.795633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac148a-b699-4d60-ad49-d12f74850b57 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:41.800450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:41.801520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.801668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.801990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] PATH_INFO: `/v3/projects/0b1ad7d34d4948619126748b0aae5300/users/4459a2c7f3664e89b5ba4d4f93781309/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.823391 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1ad7d34d4948619126748b0aae5300, user_id=4459a2c7f3664e89b5ba4d4f93781309, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:41.826379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:41.936721 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1222/2460] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:35:41 2022] PUT /identity/v3/projects/0b1ad7d34d4948619126748b0aae5300/users/4459a2c7f3664e89b5ba4d4f93781309/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:41.952130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab4c4e-deb3-4c84-ba2d-a04e62ce8e47 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:41.952346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab4c4e-deb3-4c84-ba2d-a04e62ce8e47 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:41.952639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab4c4e-deb3-4c84-ba2d-a04e62ce8e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:41.984088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6eab4c4e-deb3-4c84-ba2d-a04e62ce8e47 None None] MFA Rules not processed for user `4459a2c7f3664e89b5ba4d4f93781309`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:41.985455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6eab4c4e-deb3-4c84-ba2d-a04e62ce8e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:42.067121 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1239/2461] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:42.072907 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:42.155801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bbf1a-f78b-4f1e-99f2-ac8def1f385b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:42.160925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:42.161534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:42.161808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:42.162079 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:42.162737 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:42.164643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:42.324287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1223/2462] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:35:42 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:35:42.328743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab4c4e-deb3-4c84-ba2d-a04e62ce8e47 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:42.339702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab4c4e-deb3-4c84-ba2d-a04e62ce8e47 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:42.410805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:42.411415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:42.411695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:42.412129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:42.413146 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:42.415280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:42.546281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1240/2463] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:35:42 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:35:42.549841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:42.567262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a155f-f895-4874-aa75-f5bee6d2f677 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:42.574940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:42.577054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:42.577773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:42.578271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:42.579058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:42.581671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:42.601320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1224/2464] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:35:42.605688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:42.617544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8c06-fc33-4c57-b8c5-9e4ecfd8e52d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:42.624671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:42.626630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:42.626630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:42.626630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] PATH_INFO: `/v3/projects/a50ed35ae1214cd1957eeaec3a389101/users/3ee914ebdb134c2dbdc408a1b81c3bb0/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:42.644760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50ed35ae1214cd1957eeaec3a389101, user_id=3ee914ebdb134c2dbdc408a1b81c3bb0, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:42.648709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:42.734554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1241/2465] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:35:42 2022] PUT /identity/v3/projects/a50ed35ae1214cd1957eeaec3a389101/users/3ee914ebdb134c2dbdc408a1b81c3bb0/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:42.739606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:42.750563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce6658-55f6-490e-9388-0b45099afce2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:42.808536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:42.820575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48b66-793c-4470-b386-366a04b47f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:42.821211 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b66-793c-4470-b386-366a04b47f0a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:42.821491 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b66-793c-4470-b386-366a04b47f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:42.821863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b66-793c-4470-b386-366a04b47f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:42.822440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b48b66-793c-4470-b386-366a04b47f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:42.824174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b48b66-793c-4470-b386-366a04b47f0a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:42.835981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1225/2466] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:35:42.840452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:42.851246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4530e5-5f8f-4d63-a158-d3fdac075d83 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:42.856229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:42.857015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:42.857300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:42.857578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] PATH_INFO: `/v3/projects/a50ed35ae1214cd1957eeaec3a389101/users/3ee914ebdb134c2dbdc408a1b81c3bb0/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:42.859596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50ed35ae1214cd1957eeaec3a389101, user_id=3ee914ebdb134c2dbdc408a1b81c3bb0, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:42.862413 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:42.875280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1242/2467] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:35:42 2022] PUT /identity/v3/projects/a50ed35ae1214cd1957eeaec3a389101/users/3ee914ebdb134c2dbdc408a1b81c3bb0/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:42.887313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d511bb-8fb5-4b53-99cf-0a506e59331b None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:42.887825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d511bb-8fb5-4b53-99cf-0a506e59331b None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:42.888302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d511bb-8fb5-4b53-99cf-0a506e59331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:42.936371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-32d511bb-8fb5-4b53-99cf-0a506e59331b None None] MFA Rules not processed for user `3ee914ebdb134c2dbdc408a1b81c3bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:42.937682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-32d511bb-8fb5-4b53-99cf-0a506e59331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:43.017452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1226/2468] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:43.031338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:43.033422 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:43.069290 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:43.108353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e9268-c7de-42ee-a6a4-ad95c7817f9e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:43.112274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:43.112926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:43.113210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:43.113486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:43.124556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:43.125985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:43.138876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1243/2469] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:43.385086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d511bb-8fb5-4b53-99cf-0a506e59331b None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:43.397003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d511bb-8fb5-4b53-99cf-0a506e59331b None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:43.401058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61b71d-e86d-414b-b02c-78bbd2d9cc50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:43.401653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61b71d-e86d-414b-b02c-78bbd2d9cc50 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:43.401958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61b71d-e86d-414b-b02c-78bbd2d9cc50 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:43.402231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61b71d-e86d-414b-b02c-78bbd2d9cc50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:43.472602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61b71d-e86d-414b-b02c-78bbd2d9cc50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:43.477207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61b71d-e86d-414b-b02c-78bbd2d9cc50 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:43.489097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1227/2470] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:48.311840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:48.313469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:48.378881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378d4bf-75cc-4832-98db-f674cadc27c2 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:48.383072 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:48.383604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:48.383940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:48.384196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:48.386137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:48.453542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:48.454995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:48.465345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1244/2471] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:35:51.638990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a62908-21d0-4fce-bdaa-d7687007f317 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:51.638990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a62908-21d0-4fce-bdaa-d7687007f317 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:51.638990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a62908-21d0-4fce-bdaa-d7687007f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:51.661049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-63a62908-21d0-4fce-bdaa-d7687007f317 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:51.662286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-63a62908-21d0-4fce-bdaa-d7687007f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:51.757733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1228/2472] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:35:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:51.784615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:51.786138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:51.868249 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802996-30e1-4b77-8d5a-bc7572c77ceb service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:51.873993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3886382-4d87-4037-85d1-70289b739694 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:51.874824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886382-4d87-4037-85d1-70289b739694 service swift] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:51.875239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886382-4d87-4037-85d1-70289b739694 service swift] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:51.875692 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886382-4d87-4037-85d1-70289b739694 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:51.887076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3886382-4d87-4037-85d1-70289b739694 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:51.889842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3886382-4d87-4037-85d1-70289b739694 service swift] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:51.899040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1245/2473] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:35:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:55.988440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a62908-21d0-4fce-bdaa-d7687007f317 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:56.045060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:56.160533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a62908-21d0-4fce-bdaa-d7687007f317 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:56.171904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:56.172899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:56.174054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:56.174473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] PATH_INFO: `/v3/users/4459a2c7f3664e89b5ba4d4f93781309` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:56.175958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4459a2c7f3664e89b5ba4d4f93781309)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:56.178790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:56.445366 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4459a2c7f3664e89b5ba4d4f93781309'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:56.578028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4459a2c7f3664e89b5ba4d4f93781309'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:56.579203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4459a2c7f3664e89b5ba4d4f93781309'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:56.622774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4459a2c7f3664e89b5ba4d4f93781309'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:56.622774 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4459a2c7f3664e89b5ba4d4f93781309'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:56.629055 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1229/2474] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:35:55 2022] DELETE /identity/v3/users/4459a2c7f3664e89b5ba4d4f93781309 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:56.643957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:56.644543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:56.645162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:56.684514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:56.693992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:56.696544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:56.802220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1246/2475] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:56.813454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:56.814911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:56.890566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82c424-ba24-4cd6-9047-5eb7e5cf3337 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:56.895304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:56.896191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:56.896640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:56.897201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:56.911358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:56.913255 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:56.930804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1230/2476] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:35:57.848914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:57.851191 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:57.881916 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603481b-fe30-43dc-9737-7ceb0f3187e9 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:57.900061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:57.901488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:57.902118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:57.902501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] PATH_INFO: `/v3/projects/0b1ad7d34d4948619126748b0aae5300` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:57.908668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1ad7d34d4948619126748b0aae5300)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:57.924932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:58.188453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1ad7d34d4948619126748b0aae5300', 'request_id': 'req-0827d407-764a-4e16-b9fa-b1e7a6038f43'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:58.205737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1ad7d34d4948619126748b0aae5300', 'request_id': 'req-0827d407-764a-4e16-b9fa-b1e7a6038f43'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:58.235583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1ad7d34d4948619126748b0aae5300', 'request_id': 'req-0827d407-764a-4e16-b9fa-b1e7a6038f43'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:58.465092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] The token cache is being invalidate because project 0b1ad7d34d4948619126748b0aae5300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:35:58.465092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:58.465092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:58.468790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1247/2477] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:35:57 2022] DELETE /identity/v3/projects/0b1ad7d34d4948619126748b0aae5300 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:58.495719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:58.517783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12d405-71a7-462f-93c3-1a863d4eac3c service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:58.580415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:58.582705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:58.625303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:58.672134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827d407-764a-4e16-b9fa-b1e7a6038f43 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:58.678248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:58.688473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:58.688473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:58.688473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:58.688473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:58.744857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:58.744857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:58.744857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:58.744857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] PATH_INFO: `/v3/users/3ee914ebdb134c2dbdc408a1b81c3bb0` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:58.749339 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee914ebdb134c2dbdc408a1b81c3bb0)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:58.760039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:58.761378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:58.791326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:58.793806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:58.812790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1248/2478] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:59.198684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee914ebdb134c2dbdc408a1b81c3bb0'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:59.388712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee914ebdb134c2dbdc408a1b81c3bb0'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:59.390936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee914ebdb134c2dbdc408a1b81c3bb0'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:59.410257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee914ebdb134c2dbdc408a1b81c3bb0'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:59.426080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-ce811d2d-83a3-48dc-b7ed-752a97eaf144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee914ebdb134c2dbdc408a1b81c3bb0'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:59.435670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1231/2479] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:35:58 2022] DELETE /identity/v3/users/3ee914ebdb134c2dbdc408a1b81c3bb0 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:00.132640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:00.134297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:00.163574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bc34-1fa9-43c8-9022-e1aacb197073 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:00.335957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:00.340165 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:00.344704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:00.344704 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] PATH_INFO: `/v3/projects/a50ed35ae1214cd1957eeaec3a389101` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:00.351435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50ed35ae1214cd1957eeaec3a389101)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:00.356664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:00.611945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50ed35ae1214cd1957eeaec3a389101', 'request_id': 'req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:00.630683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50ed35ae1214cd1957eeaec3a389101', 'request_id': 'req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:00.655232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50ed35ae1214cd1957eeaec3a389101', 'request_id': 'req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:00.763461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] The token cache is being invalidate because project a50ed35ae1214cd1957eeaec3a389101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:00.772110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:00.772110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-9262490b-4ff2-4bdb-bbbc-e509fe0552d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:00.772110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1249/2480] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:00 2022] DELETE /identity/v3/projects/a50ed35ae1214cd1957eeaec3a389101 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:00.776235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83d57a-a923-49e4-8bfd-2c18fbf1f779 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:00.776678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83d57a-a923-49e4-8bfd-2c18fbf1f779 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:00.776813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83d57a-a923-49e4-8bfd-2c18fbf1f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:00.815411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-5f83d57a-a923-49e4-8bfd-2c18fbf1f779 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:00.817018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5f83d57a-a923-49e4-8bfd-2c18fbf1f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:00.921795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1232/2481] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:00.931812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f027c4-2874-4b4a-8b20-73093d972e92 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:00.932383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f027c4-2874-4b4a-8b20-73093d972e92 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:00.932889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f027c4-2874-4b4a-8b20-73093d972e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:00.982161 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-69f027c4-2874-4b4a-8b20-73093d972e92 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:00.986168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-69f027c4-2874-4b4a-8b20-73093d972e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:01.036487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1250/2482] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:01.042924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83d57a-a923-49e4-8bfd-2c18fbf1f779 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:01.057479 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83d57a-a923-49e4-8bfd-2c18fbf1f779 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:01.075610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:01.076252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:01.076528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:01.076858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:01.085693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:01.085693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:01.089670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:01.122841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1233/2483] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:36:01.125273 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f027c4-2874-4b4a-8b20-73093d972e92 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:01.146270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f027c4-2874-4b4a-8b20-73093d972e92 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:01.166507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:01.167135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:01.167414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:01.167688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:01.168439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:01.170507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:01.326197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1251/2484] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:01 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:01.327831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:01.347206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a324-0a9d-4332-94cd-074ff244207f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:01.420554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:01.441697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:01.443147 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:01.443495 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:01.447922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:01.447922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:01.447922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:01.742459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1234/2485] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:01 2022] POST /identity/v3/users => generated 282 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:01.742687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:01.761684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddee7d3-0997-4270-a2d3-f697faa9767e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:01.779775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:01.780924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:01.781434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:01.782067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:01.784456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:01.790088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:01.814170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1252/2486] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:01.816136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:01.830934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e2ec6-3e09-4952-8237-6a54b7d01511 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:01.837830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa506-4014-415d-af7f-27442131f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:01.839743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa506-4014-415d-af7f-27442131f11e admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:01.840874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa506-4014-415d-af7f-27442131f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:01.841401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa506-4014-415d-af7f-27442131f11e admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:01.843027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fa506-4014-415d-af7f-27442131f11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:01.845251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fa506-4014-415d-af7f-27442131f11e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:01.863663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1235/2487] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:01.867735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:01.890895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab07f-51b3-4516-8175-32140c41a3b8 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:01.895994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:01.896767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:01.897002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:01.897279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] PATH_INFO: `/v3/projects/6a50c2fb5be84172a2f5a8ff3b9a7614/users/c0e62edded854955a710aa7317f240ec/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:01.919802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a50c2fb5be84172a2f5a8ff3b9a7614, user_id=c0e62edded854955a710aa7317f240ec, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:01.923004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:02.132888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1253/2488] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:01 2022] PUT /identity/v3/projects/6a50c2fb5be84172a2f5a8ff3b9a7614/users/c0e62edded854955a710aa7317f240ec/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:02.144994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b82d-0e66-4b78-af2d-9ad8fed9a167 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:02.145225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b82d-0e66-4b78-af2d-9ad8fed9a167 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:02.145493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b82d-0e66-4b78-af2d-9ad8fed9a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:02.177565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-3511b82d-0e66-4b78-af2d-9ad8fed9a167 None None] MFA Rules not processed for user `c0e62edded854955a710aa7317f240ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:02.178859 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3511b82d-0e66-4b78-af2d-9ad8fed9a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:02.265525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1236/2489] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:02.270909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:02.284336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:02.396434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b864c9d-521e-47ad-8bc6-f7bbd7c1701f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:02.408664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:02.410156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:02.410872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:02.411358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:02.412471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:02.415190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:02.609190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1254/2490] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:02 2022] POST /identity/v3/projects => generated 363 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:02.614670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b82d-0e66-4b78-af2d-9ad8fed9a167 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:02.629605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b82d-0e66-4b78-af2d-9ad8fed9a167 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:02.759524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:02.760178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:02.760463 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:02.760719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:02.765205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:02.767416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:02.988827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1237/2491] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:02 2022] POST /identity/v3/users => generated 288 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:02.991554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:03.009191 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28177eca-dc0f-472a-b895-76f0984b9c99 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:03.022529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:03.024392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:03.025552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:03.025997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:03.034952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:03.034952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:03.080933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1255/2492] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:03.090230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:03.107584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66603185-ebda-419c-ac07-4a6422ff9edb admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:03.128209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:03.129345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:03.129863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:03.130377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] PATH_INFO: `/v3/projects/55a2f569cb94449496457d40306046c4/users/4c259c36aacf4f37a645af1226544f59/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:03.178436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a2f569cb94449496457d40306046c4, user_id=4c259c36aacf4f37a645af1226544f59, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:03.181895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:03.287727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1238/2493] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:03 2022] PUT /identity/v3/projects/55a2f569cb94449496457d40306046c4/users/4c259c36aacf4f37a645af1226544f59/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:03.292513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:03.306742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a98100-e595-4dde-8f77-b4d3528f45e6 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:03.397397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3071d61-311b-40cf-9528-c351a9c47869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:03.398009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3071d61-311b-40cf-9528-c351a9c47869 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:03.398499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3071d61-311b-40cf-9528-c351a9c47869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:03.398778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3071d61-311b-40cf-9528-c351a9c47869 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:03.399429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3071d61-311b-40cf-9528-c351a9c47869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:03.401749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3071d61-311b-40cf-9528-c351a9c47869 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:03.416391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1256/2494] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:03.422746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:03.438804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4238d7-1055-4818-86f5-be292ae9676d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:03.444237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:03.444940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:03.445413 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:03.445508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] PATH_INFO: `/v3/projects/55a2f569cb94449496457d40306046c4/users/4c259c36aacf4f37a645af1226544f59/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:03.447816 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a2f569cb94449496457d40306046c4, user_id=4c259c36aacf4f37a645af1226544f59, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:03.451342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:03.464776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1239/2495] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:03 2022] PUT /identity/v3/projects/55a2f569cb94449496457d40306046c4/users/4c259c36aacf4f37a645af1226544f59/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:03.476012 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:03.476380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:03.476653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:03.507792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] MFA Rules not processed for user `4c259c36aacf4f37a645af1226544f59`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:03.509430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:03.605118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1257/2496] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:03.617855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:03.618384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:03.628863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:03.740969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d687-9235-4a4b-8a37-a001800dac43 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:03.750876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:03.751516 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:03.751797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:03.752069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:03.783747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:03.783747 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:03.798961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1240/2497] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:04.695870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:04.697918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:04.704448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:04.848070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dcb20-d8cc-4185-9ba8-3fbaed839ed2 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:04.853013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:04.853943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:04.854382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:04.854827 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:04.857187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:05.008842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:05.011449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:05.018336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:05.018336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:05.044630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1258/2498] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:05.093398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94647d-95b3-42f6-bf42-ecc400802827 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:05.107756 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:05.108620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:05.109077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:05.109656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] PATH_INFO: `/v3/users/a780135a7e6b464a8cb48d7e39e96e80` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:05.114689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a780135a7e6b464a8cb48d7e39e96e80)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:05.117186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:05.492577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a780135a7e6b464a8cb48d7e39e96e80'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.515626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:05.563355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35ad34-487c-46a5-aa80-4f7591f1558e service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:05.563355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:05.563355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:05.563355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:05.564463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] PATH_INFO: `/v3/users/c0e62edded854955a710aa7317f240ec` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:05.564463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e62edded854955a710aa7317f240ec)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:05.564463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:05.626518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a780135a7e6b464a8cb48d7e39e96e80'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.628899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a780135a7e6b464a8cb48d7e39e96e80'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.661820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a780135a7e6b464a8cb48d7e39e96e80'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.692345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-f790b62f-dc5e-41b9-b8fa-c949a9e1e090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a780135a7e6b464a8cb48d7e39e96e80'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.722982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1241/2499] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:05 2022] DELETE /identity/v3/users/a780135a7e6b464a8cb48d7e39e96e80 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:05.734282 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:05.736229 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:05.737231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:05.792027 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:05.795185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:05.880933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e62edded854955a710aa7317f240ec'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.889268 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e62edded854955a710aa7317f240ec'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.986256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1242/2500] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:05.991042 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e62edded854955a710aa7317f240ec'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:05.999899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e62edded854955a710aa7317f240ec'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:06.000670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-614cf4cc-aaef-4814-bcd2-f3ca1c382406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e62edded854955a710aa7317f240ec'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:06.037007 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:06.039111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:06.060983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1259/2501] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:05 2022] DELETE /identity/v3/users/c0e62edded854955a710aa7317f240ec => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:06.065438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044b68-2b35-4572-84f5-bd4deee9b5fb None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:06.068326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044b68-2b35-4572-84f5-bd4deee9b5fb None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:06.068999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044b68-2b35-4572-84f5-bd4deee9b5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:06.100785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:06.114829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-aa044b68-2b35-4572-84f5-bd4deee9b5fb None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:06.117164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-aa044b68-2b35-4572-84f5-bd4deee9b5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:06.174676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:06.186026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa4dea-7434-440a-9332-7dfca4db19b1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:06.265882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1260/2502] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:06.298863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa044b68-2b35-4572-84f5-bd4deee9b5fb None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:06.309812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:06.310458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:06.310840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:06.311183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:06.354235 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:06.360715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:06.375183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1243/2503] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:06.440509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa044b68-2b35-4572-84f5-bd4deee9b5fb None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:06.458315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:06.458980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:06.459429 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:06.459718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:06.480804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:06.482890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:06.502417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1261/2504] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:07.398674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:07.402204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:07.435709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9931bb-db94-42ad-936b-ffb7c2b71d70 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:07.450419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:07.452647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:07.454365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:07.454911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] PATH_INFO: `/v3/projects/df86a5ddbd414e7ebe29ce40d3804790` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:07.459035 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df86a5ddbd414e7ebe29ce40d3804790)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:07.465815 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:07.494735 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:07.497889 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:07.551753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d94638-74cb-41ad-9e4f-fc429c545c78 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:07.563678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:07.564980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:07.566335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:07.567181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] PATH_INFO: `/v3/projects/6a50c2fb5be84172a2f5a8ff3b9a7614` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:07.571536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a50c2fb5be84172a2f5a8ff3b9a7614)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:07.578250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:07.735729 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df86a5ddbd414e7ebe29ce40d3804790', 'request_id': 'req-079429ba-6052-4f14-a674-182c1c652fd9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.750420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df86a5ddbd414e7ebe29ce40d3804790', 'request_id': 'req-079429ba-6052-4f14-a674-182c1c652fd9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.790912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a50c2fb5be84172a2f5a8ff3b9a7614', 'request_id': 'req-860a3c81-cde4-4c10-8eb5-973928635b1b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.798597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a50c2fb5be84172a2f5a8ff3b9a7614', 'request_id': 'req-860a3c81-cde4-4c10-8eb5-973928635b1b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.811962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a50c2fb5be84172a2f5a8ff3b9a7614', 'request_id': 'req-860a3c81-cde4-4c10-8eb5-973928635b1b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.833462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df86a5ddbd414e7ebe29ce40d3804790', 'request_id': 'req-079429ba-6052-4f14-a674-182c1c652fd9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.854814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] The token cache is being invalidate because project df86a5ddbd414e7ebe29ce40d3804790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:07.855228 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.858843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.859329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1244/2505] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:07 2022] DELETE /identity/v3/projects/df86a5ddbd414e7ebe29ce40d3804790 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:07.863299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:07.865335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:07.961248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] The token cache is being invalidate because project 6a50c2fb5be84172a2f5a8ff3b9a7614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:07.961603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.965579 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:07.975866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1262/2506] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:07 2022] DELETE /identity/v3/projects/6a50c2fb5be84172a2f5a8ff3b9a7614 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:07.981518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:07.989550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:08.010006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079429ba-6052-4f14-a674-182c1c652fd9 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:08.020649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:08.116697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:08.118009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:08.118575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:08.119909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] PATH_INFO: `/v3/users/3193bd0b7f2f4861951e1dd03a094306` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:08.123004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3193bd0b7f2f4861951e1dd03a094306)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:08.125310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:08.212631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:08.248104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a3c81-cde4-4c10-8eb5-973928635b1b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:08.255529 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:08.256329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:08.256617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:08.256934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] PATH_INFO: `/v3/users/4c259c36aacf4f37a645af1226544f59` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:08.258212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c259c36aacf4f37a645af1226544f59)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:08.260289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:08.488615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3193bd0b7f2f4861951e1dd03a094306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.577404 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c259c36aacf4f37a645af1226544f59'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.578154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c259c36aacf4f37a645af1226544f59'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.602334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3193bd0b7f2f4861951e1dd03a094306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.602998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3193bd0b7f2f4861951e1dd03a094306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.641856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3193bd0b7f2f4861951e1dd03a094306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.658634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3193bd0b7f2f4861951e1dd03a094306'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.675789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1245/2507] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:07 2022] DELETE /identity/v3/users/3193bd0b7f2f4861951e1dd03a094306 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:08.729242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c259c36aacf4f37a645af1226544f59'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.732106 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c259c36aacf4f37a645af1226544f59'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.741763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c259c36aacf4f37a645af1226544f59'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:08.795441 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1263/2508] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:07 2022] DELETE /identity/v3/users/4c259c36aacf4f37a645af1226544f59 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:10.022627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:10.026906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:10.156955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bb6bb-9b3f-486e-b121-5c9531fce945 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:10.303395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:10.342731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:10.342731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:10.406101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:10.407444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:10.407444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:10.407715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] PATH_INFO: `/v3/projects/beaa4d4efcf843d68d58ac66be2bd49d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:10.409525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=beaa4d4efcf843d68d58ac66be2bd49d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:10.411526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:10.542109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bc2b2-8e3a-4141-bea5-99a3e08520ee admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:10.550050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:10.551837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:10.552439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:10.552899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] PATH_INFO: `/v3/projects/55a2f569cb94449496457d40306046c4` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:10.555242 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a2f569cb94449496457d40306046c4)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:10.557584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:10.633676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beaa4d4efcf843d68d58ac66be2bd49d', 'request_id': 'req-4fb770c8-3f35-419a-a07a-337a6601cf4a'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.688048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beaa4d4efcf843d68d58ac66be2bd49d', 'request_id': 'req-4fb770c8-3f35-419a-a07a-337a6601cf4a'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.788667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beaa4d4efcf843d68d58ac66be2bd49d', 'request_id': 'req-4fb770c8-3f35-419a-a07a-337a6601cf4a'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.853634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] The token cache is being invalidate because project beaa4d4efcf843d68d58ac66be2bd49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:10.854135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.856029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4fb770c8-3f35-419a-a07a-337a6601cf4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.865793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1246/2509] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:10 2022] DELETE /identity/v3/projects/beaa4d4efcf843d68d58ac66be2bd49d => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:10.875086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a2f569cb94449496457d40306046c4', 'request_id': 'req-b62d67a3-c35f-445b-9592-906af8b5a831'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.875378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9f73-c8eb-4d09-a0d3-b37b38551708 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:10.875753 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9f73-c8eb-4d09-a0d3-b37b38551708 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:10.876242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9f73-c8eb-4d09-a0d3-b37b38551708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:10.895814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a2f569cb94449496457d40306046c4', 'request_id': 'req-b62d67a3-c35f-445b-9592-906af8b5a831'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.912494 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a2f569cb94449496457d40306046c4', 'request_id': 'req-b62d67a3-c35f-445b-9592-906af8b5a831'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:10.950714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0f9f9f73-c8eb-4d09-a0d3-b37b38551708 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:10.953431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0f9f9f73-c8eb-4d09-a0d3-b37b38551708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:11.043804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:11.058269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] The token cache is being invalidate because project 55a2f569cb94449496457d40306046c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:11.059221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:11.060489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b62d67a3-c35f-445b-9592-906af8b5a831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:11.067442 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1264/2510] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:10 2022] DELETE /identity/v3/projects/55a2f569cb94449496457d40306046c4 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:11.075666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd540e-ae38-4353-bf39-e84e9a4f580f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.077141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd540e-ae38-4353-bf39-e84e9a4f580f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.077867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd540e-ae38-4353-bf39-e84e9a4f580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.161021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-34bd540e-ae38-4353-bf39-e84e9a4f580f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:11.162309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-34bd540e-ae38-4353-bf39-e84e9a4f580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:11.166847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1247/2511] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:11.175141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1265/2512] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:11.183830 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7296-e497-4cf2-bafa-b2a58d6f106f None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.184444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7296-e497-4cf2-bafa-b2a58d6f106f None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.185169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7296-e497-4cf2-bafa-b2a58d6f106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.185540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e67224-74e4-47b2-a4ea-af391755102b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.188377 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e67224-74e4-47b2-a4ea-af391755102b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.188814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e67224-74e4-47b2-a4ea-af391755102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.221034 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e1e67224-74e4-47b2-a4ea-af391755102b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:11.222813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e1e67224-74e4-47b2-a4ea-af391755102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:11.227870 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-90cf7296-e497-4cf2-bafa-b2a58d6f106f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:11.230121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-90cf7296-e497-4cf2-bafa-b2a58d6f106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:11.233520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1266/2513] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:11.242575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e67224-74e4-47b2-a4ea-af391755102b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.258809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1248/2514] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:11.262722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e67224-74e4-47b2-a4ea-af391755102b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.268993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7296-e497-4cf2-bafa-b2a58d6f106f None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.285455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.287681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.289316 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.292713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.292713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:11.295535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.299851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.302128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7296-e497-4cf2-bafa-b2a58d6f106f None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.318545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.319287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.319662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.321598 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.322407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:11.324754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.330210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.337951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1267/2515] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:36:11.344269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.363742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1249/2516] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:36:11.365574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.370661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f70a2-599f-4e85-b559-b03643e304a4 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.392978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.393775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.394163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.394853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.395624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.397487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bbb30-d627-46e9-873e-e0cc0423bb0e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.397911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.407148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.407850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.408131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.408406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.409131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.411431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.510588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1268/2517] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:11 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:11.516066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1250/2518] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:11 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:11.516540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.518283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.594052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:11.687292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23e170-384a-428b-9dd3-579086033f56 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.688380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7ec2-9a61-4345-8a23-c407703be0b2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.697896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.698900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.699672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.700460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.701905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.702471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.705523 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.711350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.712264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.712633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.713950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.725752 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.798380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1269/2519] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:11 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:11.807257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.823774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5f71-ea8c-4b11-8a46-c486830f63da admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.827168 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1251/2520] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:11 2022] POST /identity/v3/users => generated 291 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:11.830759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.844876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.845718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.846135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.846872 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.847669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.849622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.887543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1270/2521] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:11.889882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.892464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dcb01-8b68-4db2-817d-d096ca45e9b4 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.903781 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.904550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.905028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.906296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.906296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.908549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.920573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cedf08-670c-402a-be8a-d62c69ddb88e admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:11.928135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1252/2522] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:11.936176 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:11.937236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:11.937593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:11.937810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:11.938465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:11.946291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:11.952642 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:11.978814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1271/2523] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:11.989340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:12.011317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3a560-9d9a-462f-a7c3-81dcae129ce3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:12.016094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fe15-6615-4b80-8e6e-0985b83906a9 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:12.031476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:12.034820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:12.035159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:12.035456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:12.036843 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:12.037271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd386-0afc-4356-9958-887750f3ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:12.037804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:12.037930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd386-0afc-4356-9958-887750f3ed7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:12.038223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd386-0afc-4356-9958-887750f3ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:12.038505 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd386-0afc-4356-9958-887750f3ed7a admin admin] PATH_INFO: `/v3/projects/4904ef45a35b420fb80668f397ccff6d/users/29c00d8844f040699f7d97600946be15/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:12.072460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1253/2524] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:12.081709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:12.097037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b26f3-d9a9-4f28-a474-080f99c4f2fa admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:12.109334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740f182-ee16-4c73-b161-53e3689beba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:12.111324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f182-ee16-4c73-b161-53e3689beba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:12.111636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f182-ee16-4c73-b161-53e3689beba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:12.111956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f182-ee16-4c73-b161-53e3689beba9 admin admin] PATH_INFO: `/v3/projects/1d6a392e19db4bac9d007bae20eddad4/users/4d017c792e9648bdae473a8eb956c70f/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:12.112202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd386-0afc-4356-9958-887750f3ed7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4904ef45a35b420fb80668f397ccff6d, user_id=29c00d8844f040699f7d97600946be15, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:12.114911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd386-0afc-4356-9958-887750f3ed7a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:12.140264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740f182-ee16-4c73-b161-53e3689beba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6a392e19db4bac9d007bae20eddad4, user_id=4d017c792e9648bdae473a8eb956c70f, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:12.143528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740f182-ee16-4c73-b161-53e3689beba9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:12.223861 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1254/2525] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:12 2022] PUT /identity/v3/projects/1d6a392e19db4bac9d007bae20eddad4/users/4d017c792e9648bdae473a8eb956c70f/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:12.235365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a205-177b-4772-8b07-3af157ce43f1 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:12.235622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1272/2526] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:11 2022] PUT /identity/v3/projects/4904ef45a35b420fb80668f397ccff6d/users/29c00d8844f040699f7d97600946be15/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:12.235811 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a205-177b-4772-8b07-3af157ce43f1 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:12.236110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a205-177b-4772-8b07-3af157ce43f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:12.257927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c508f-2a8f-4e59-9424-85b4e1e978a6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:12.258320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c508f-2a8f-4e59-9424-85b4e1e978a6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:12.258687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c508f-2a8f-4e59-9424-85b4e1e978a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:12.340997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-369c508f-2a8f-4e59-9424-85b4e1e978a6 None None] MFA Rules not processed for user `29c00d8844f040699f7d97600946be15`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:12.342184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-369c508f-2a8f-4e59-9424-85b4e1e978a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:12.421441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-1173a205-177b-4772-8b07-3af157ce43f1 None None] MFA Rules not processed for user `4d017c792e9648bdae473a8eb956c70f`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:12.432082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1173a205-177b-4772-8b07-3af157ce43f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:12.515813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:12.560047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1273/2527] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:12.565068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c508f-2a8f-4e59-9424-85b4e1e978a6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:12.639630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1255/2528] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:12.642374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173a205-177b-4772-8b07-3af157ce43f1 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:12.730656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c508f-2a8f-4e59-9424-85b4e1e978a6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:12.749609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:12.750575 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:12.751407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:12.751407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:12.753738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:12.756359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:12.814803 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:12.831663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173a205-177b-4772-8b07-3af157ce43f1 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:12.851169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:12.851805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:12.852073 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:12.852507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:12.853199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:12.860195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:12.920375 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1274/2529] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:12 2022] POST /identity/v3/projects => generated 387 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:12.921561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:13.021894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9c63-9eb0-4d3a-84ef-623c0d0fe2c0 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:13.045142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1256/2530] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:12 2022] POST /identity/v3/projects => generated 381 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:13.049271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:13.055469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:13.056393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:13.056672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:13.056971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:13.060980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:13.064871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:13.190651 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1377c9b-fc35-4328-85b4-2f6b74980d1f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:13.200630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:13.201533 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:13.202047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:13.202532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:13.205308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:13.205683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:13.211584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1275/2531] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:12 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:13.217835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:13.244678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259cdd1-3a4a-499f-8763-9c71de4a8de2 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:13.258070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:13.259003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:13.259294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:13.259573 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:13.260405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:13.262412 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:13.298138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1276/2532] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:13.310511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:13.326051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc844d8-baa0-4864-839a-92499bb3afce admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:13.335433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1257/2533] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:13 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:13.343744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:13.350895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:13.351425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:13.351425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:13.351425 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] PATH_INFO: `/v3/projects/29ed7db7999643009fb49cd0a0228d6e/users/7e44f89ee813412d9b845ff72c1df880/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:13.375210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044737-4a04-4b9e-a762-d157a426cbe3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:13.394454 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:13.397377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:13.397377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:13.401224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:13.402689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:13.408120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:13.437419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ed7db7999643009fb49cd0a0228d6e, user_id=7e44f89ee813412d9b845ff72c1df880, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:13.445974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:13.462916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1258/2534] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:13.462916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:13.464285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:13.509838 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ef46-a3be-477c-96fc-ef59ccef1a68 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:13.528427 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1277/2535] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:13 2022] PUT /identity/v3/projects/29ed7db7999643009fb49cd0a0228d6e/users/7e44f89ee813412d9b845ff72c1df880/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:13.533337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:13.605145 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:13.632520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:13.633947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:13.633947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:13.634636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] PATH_INFO: `/v3/users/db5b31d25b264b17bd91549c166e901e` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:13.636331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5b31d25b264b17bd91549c166e901e)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:13.640018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:13.724954 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffefe5-b250-4879-9126-c42e51f4160a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:13.735015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:13.735741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:13.736025 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:13.736313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] PATH_INFO: `/v3/projects/d910185ba44a4d1daf6e7b35ce05d609/users/0e8c169a96a14258bb8fc1f0357654ba/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:13.772355 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d910185ba44a4d1daf6e7b35ce05d609, user_id=0e8c169a96a14258bb8fc1f0357654ba, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:13.776277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:14.169381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1278/2536] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:13 2022] PUT /identity/v3/projects/d910185ba44a4d1daf6e7b35ce05d609/users/0e8c169a96a14258bb8fc1f0357654ba/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:14.170272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:14.197862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5b31d25b264b17bd91549c166e901e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:14.274461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9a28-d738-4253-9783-7610da557928 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:14.279890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:14.281018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:14.281156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:14.281406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:14.282108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:14.283796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:14.301077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1279/2537] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:14.303063 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:14.309746 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:14.320224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5b31d25b264b17bd91549c166e901e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:14.320224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5b31d25b264b17bd91549c166e901e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:14.334206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:14.342006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5b31d25b264b17bd91549c166e901e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:14.354308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5b31d25b264b17bd91549c166e901e'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:14.364182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1259/2538] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:13 2022] DELETE /identity/v3/users/db5b31d25b264b17bd91549c166e901e => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:14.366741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:14.369398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:14.467557 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5e4a3-85c6-4537-9959-ce1129f1749a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:14.482409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d1855-e148-4d9b-9cda-722d44b0a9b8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:14.488619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:14.489867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:14.490331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:14.490731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:14.491771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:14.493714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:14.513666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1260/2539] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:14.515032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:14.517958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:14.534093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165b3c-ae13-4001-84fd-f9730af39535 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:14.539829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:14.540961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:14.540961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:14.541440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] PATH_INFO: `/v3/users/1f12fa71a876411f91c2bbaf3c9080ce` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:14.546509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:14.573181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f12fa71a876411f91c2bbaf3c9080ce)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:14.578397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:14.599512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:14.599512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:14.607223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:14.607223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:14.608565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:14.625278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:14.626915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:14.652231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1280/2540] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:14.653938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:14.656644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:14.676669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c06d3-2b1d-4679-82fc-12b796becfde service placement] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:14.683206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:14.684170 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:14.684565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:14.685031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] PATH_INFO: `/v3/projects/29ed7db7999643009fb49cd0a0228d6e/users/7e44f89ee813412d9b845ff72c1df880/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:14.687689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ed7db7999643009fb49cd0a0228d6e, user_id=7e44f89ee813412d9b845ff72c1df880, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:14.690543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:14.718119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1281/2541] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:14 2022] PUT /identity/v3/projects/29ed7db7999643009fb49cd0a0228d6e/users/7e44f89ee813412d9b845ff72c1df880/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:14.728020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:14.843016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb344e-20de-4b86-be34-27ab703ded49 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:14.856903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f8882-c3aa-4f9e-b4c2-6cf121bc54e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:14.858406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f8882-c3aa-4f9e-b4c2-6cf121bc54e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:14.859035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f8882-c3aa-4f9e-b4c2-6cf121bc54e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:14.859580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f8882-c3aa-4f9e-b4c2-6cf121bc54e0 admin admin] PATH_INFO: `/v3/projects/d910185ba44a4d1daf6e7b35ce05d609/users/0e8c169a96a14258bb8fc1f0357654ba/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:14.863241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f8882-c3aa-4f9e-b4c2-6cf121bc54e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d910185ba44a4d1daf6e7b35ce05d609, user_id=0e8c169a96a14258bb8fc1f0357654ba, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:14.868793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f8882-c3aa-4f9e-b4c2-6cf121bc54e0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:14.899493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1282/2542] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:14 2022] PUT /identity/v3/projects/d910185ba44a4d1daf6e7b35ce05d609/users/0e8c169a96a14258bb8fc1f0357654ba/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:14.901803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:14.902552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:14.902855 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:14.942246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f12fa71a876411f91c2bbaf3c9080ce'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:14.973568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] MFA Rules not processed for user `7e44f89ee813412d9b845ff72c1df880`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:14.975168 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.077508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f12fa71a876411f91c2bbaf3c9080ce'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.078116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f12fa71a876411f91c2bbaf3c9080ce'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.108842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f12fa71a876411f91c2bbaf3c9080ce'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.114501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1283/2543] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:15.115745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:15.131805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.133647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c8a0a9de-bee3-44f9-828f-d7ce60a392e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f12fa71a876411f91c2bbaf3c9080ce'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.156992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1261/2544] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:14 2022] DELETE /identity/v3/users/1f12fa71a876411f91c2bbaf3c9080ce => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:15.156992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:15.156992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:15.167097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:15.230367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] MFA Rules not processed for user `0e8c169a96a14258bb8fc1f0357654ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:15.232674 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.269036 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:15.301167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:15.323765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f49ab-ca73-41e2-8110-d6ce19ec0616 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:15.417254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1262/2545] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:15.420646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:15.424591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.500965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:15.501560 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:15.502393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:15.502393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] PATH_INFO: `/v3/projects/47caffccdd2d4b28a225c06e7f30e0cb` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:15.506076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47caffccdd2d4b28a225c06e7f30e0cb)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:15.519478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:15.524049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad36e-877e-4e49-8d31-0a49f5003b7a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:15.529496 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:15.530312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:15.530817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:15.531195 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:15.533666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.676605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:15.678520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:15.690912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47caffccdd2d4b28a225c06e7f30e0cb', 'request_id': 'req-77f0adee-378b-44c6-b73f-91d8f6db5033'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.696800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1263/2546] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:15.698484 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:15.701082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.728460 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47caffccdd2d4b28a225c06e7f30e0cb', 'request_id': 'req-77f0adee-378b-44c6-b73f-91d8f6db5033'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.731088 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d9d30-b48d-42bd-a198-3736a11989e5 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:15.746345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47caffccdd2d4b28a225c06e7f30e0cb', 'request_id': 'req-77f0adee-378b-44c6-b73f-91d8f6db5033'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.895629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] The token cache is being invalidate because project 47caffccdd2d4b28a225c06e7f30e0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:15.898508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.901186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:15.903308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:15.904154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:15.904622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:15.904909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:15.912966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1284/2547] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:15 2022] DELETE /identity/v3/projects/47caffccdd2d4b28a225c06e7f30e0cb => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:15.912966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:15.915201 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.920263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:15.994572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:16.046993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:16.047499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0adee-378b-44c6-b73f-91d8f6db5033 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:16.048744 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:16.053492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:16.054491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:16.054971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:16.055254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] PATH_INFO: `/v3/projects/cb747266dddb45e695b0c667ee28fa18` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:16.061464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1264/2548] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:16.062348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:16.063812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:16.076263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb747266dddb45e695b0c667ee28fa18)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:16.081603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:16.085087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94295b4-9a50-4872-88bb-e95b5d115546 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:16.096631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:16.103695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:16.105884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:16.105884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] PATH_INFO: `/v3/users/29c00d8844f040699f7d97600946be15` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:16.106260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:16.106362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c00d8844f040699f7d97600946be15)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:16.108639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:16.387807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c00d8844f040699f7d97600946be15'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.392109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb747266dddb45e695b0c667ee28fa18', 'request_id': 'req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.400493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb747266dddb45e695b0c667ee28fa18', 'request_id': 'req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.413360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb747266dddb45e695b0c667ee28fa18', 'request_id': 'req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.534431 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c00d8844f040699f7d97600946be15'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.535237 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c00d8844f040699f7d97600946be15'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.561567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c00d8844f040699f7d97600946be15'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.571865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c00d8844f040699f7d97600946be15'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.587974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1265/2549] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:16 2022] DELETE /identity/v3/users/29c00d8844f040699f7d97600946be15 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:16.587974 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:16.589053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:16.677849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] The token cache is being invalidate because project cb747266dddb45e695b0c667ee28fa18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:16.686558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.686558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7359ed70-d269-48d6-a8f4-bc6d6080e3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:16.686558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1285/2550] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:15 2022] DELETE /identity/v3/projects/cb747266dddb45e695b0c667ee28fa18 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:16.686558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee234-e538-4ede-b04d-5c9edc9d998c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:16.686558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee234-e538-4ede-b04d-5c9edc9d998c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:16.687309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dee234-e538-4ede-b04d-5c9edc9d998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:16.697334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db466b-2c62-476b-98d8-2aa1055a6158 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:16.703324 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:16.704294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:16.704848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:16.705432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] PATH_INFO: `/v3/users/aa7f3f58cf5c44e9a2aee79c50f45bd6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:16.707518 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7f3f58cf5c44e9a2aee79c50f45bd6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:16.709904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:16.724330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e8dee234-e538-4ede-b04d-5c9edc9d998c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:16.755567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e8dee234-e538-4ede-b04d-5c9edc9d998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:16.755567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1286/2551] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:16.755567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:16.755567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:16.755567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:16.771566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:16.771566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:16.788052 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1287/2552] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:16.788957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:16.790467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:16.879407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14675b15-5699-43d0-9a60-49bc09e8707a None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:16.885271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9911482-08bb-4f2c-970e-3afde02002c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:16.886200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911482-08bb-4f2c-970e-3afde02002c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:16.886727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911482-08bb-4f2c-970e-3afde02002c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:16.887069 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9911482-08bb-4f2c-970e-3afde02002c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:16.906966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9911482-08bb-4f2c-970e-3afde02002c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:16.910152 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9911482-08bb-4f2c-970e-3afde02002c2 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:16.925930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1288/2553] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:16.927417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:16.927828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:16.928222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:16.966588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:16.968185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:16.977956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1289/2554] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:16.979055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:16.981368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:17.014486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd589fe2-d7e3-406e-8607-24870ad3a80f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:17.021988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:17.022561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:17.022840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:17.023124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] PATH_INFO: `/v3/users/4d017c792e9648bdae473a8eb956c70f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:17.024555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d017c792e9648bdae473a8eb956c70f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:17.027656 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:17.176799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:17.188700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7f3f58cf5c44e9a2aee79c50f45bd6'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.340120 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7f3f58cf5c44e9a2aee79c50f45bd6'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.341359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7f3f58cf5c44e9a2aee79c50f45bd6'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.365839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7f3f58cf5c44e9a2aee79c50f45bd6'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.377881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7f3f58cf5c44e9a2aee79c50f45bd6'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.391026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1266/2555] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:16 2022] DELETE /identity/v3/users/aa7f3f58cf5c44e9a2aee79c50f45bd6 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:17.392110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:17.398532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:17.446105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d017c792e9648bdae473a8eb956c70f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.446949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d017c792e9648bdae473a8eb956c70f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.527131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b165b-c4d1-415a-9e74-7340c3dba63a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:17.541574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:17.545596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:17.545596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:17.549042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:17.551714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:17.551714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:17.552789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:17.568630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1267/2556] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:36:17.575915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:17.583347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:17.601378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a36c7-cc2a-4466-80a6-ec2c031a7cc9 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:17.609020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:17.609836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d017c792e9648bdae473a8eb956c70f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.610308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:17.610622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d017c792e9648bdae473a8eb956c70f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.610742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:17.611175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:17.612325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:17.615036 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:17.625045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fc70aa-cb4b-4e6e-9c0f-2e17fb883590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d017c792e9648bdae473a8eb956c70f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:17.650869 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:17.665154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1290/2557] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:16 2022] DELETE /identity/v3/users/4d017c792e9648bdae473a8eb956c70f => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:17.667368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb019d6-2c5a-48be-b706-dcd34e8635ba None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:17.668212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb019d6-2c5a-48be-b706-dcd34e8635ba None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:17.669711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb019d6-2c5a-48be-b706-dcd34e8635ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:17.695002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9eb019d6-2c5a-48be-b706-dcd34e8635ba None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:17.700250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9eb019d6-2c5a-48be-b706-dcd34e8635ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:17.770264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1268/2558] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:17 2022] POST /identity/v3/projects => generated 405 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:17.770264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:17.776791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:17.859408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1291/2559] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:17.859408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb019d6-2c5a-48be-b706-dcd34e8635ba None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:17.875911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb019d6-2c5a-48be-b706-dcd34e8635ba None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:17.910707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11619aaa-b465-41a4-b85e-5f33632f2785 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:17.918457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:17.919407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:17.919904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:17.920283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] PATH_INFO: `/v3/projects/4904ef45a35b420fb80668f397ccff6d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:17.921902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4904ef45a35b420fb80668f397ccff6d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:17.923990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:17.968454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:17.969135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:17.969419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:17.969694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:17.970338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:17.972332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:18.239210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:18.256198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4904ef45a35b420fb80668f397ccff6d', 'request_id': 'req-c1a3a01f-7993-4454-a8a5-6b3894617d37'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.265705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1292/2560] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:17 2022] POST /identity/v3/users => generated 303 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:18.266945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:18.267087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4904ef45a35b420fb80668f397ccff6d', 'request_id': 'req-c1a3a01f-7993-4454-a8a5-6b3894617d37'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.269147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:18.281737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f116f5-7af6-401f-8adb-fdeffb91b164 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:18.351797 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:18.352657 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:18.352965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:18.353250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] PATH_INFO: `/v3/projects/6130bdfbe104465e8e8d63e0fb14cd70` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:18.354432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6130bdfbe104465e8e8d63e0fb14cd70)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:18.357477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:18.368004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4904ef45a35b420fb80668f397ccff6d', 'request_id': 'req-c1a3a01f-7993-4454-a8a5-6b3894617d37'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.385853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] The token cache is being invalidate because project 4904ef45a35b420fb80668f397ccff6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:18.386174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.386942 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.388667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1269/2561] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:17 2022] DELETE /identity/v3/projects/4904ef45a35b420fb80668f397ccff6d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:18.393476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:18.394949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:18.509865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a01f-7993-4454-a8a5-6b3894617d37 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:18.522621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:18.529217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:18.530275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:18.530890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:18.531768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:18.534921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:18.555383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:18.555982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:18.580988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6130bdfbe104465e8e8d63e0fb14cd70', 'request_id': 'req-44013acd-ce49-4bce-87c2-25d1a43ae481'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.588883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1270/2562] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:18.600983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:18.603453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6130bdfbe104465e8e8d63e0fb14cd70', 'request_id': 'req-44013acd-ce49-4bce-87c2-25d1a43ae481'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.605256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:18.614819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6130bdfbe104465e8e8d63e0fb14cd70', 'request_id': 'req-44013acd-ce49-4bce-87c2-25d1a43ae481'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.649882 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bfddc-d46d-4353-a445-574dea0f0140 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:18.750568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:18.751607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:18.751960 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:18.752313 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:18.753831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:18.756004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:18.767643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] The token cache is being invalidate because project 6130bdfbe104465e8e8d63e0fb14cd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:18.767643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.772421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1271/2563] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:18.773473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:18.773620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:18.775539 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:18.780813 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1293/2564] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:18 2022] DELETE /identity/v3/projects/6130bdfbe104465e8e8d63e0fb14cd70 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:18.785953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:18.789857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:18.801004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c946484-60dd-4f21-9e49-d564299ba748 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:18.813912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:18.814734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:18.815213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:18.815754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] PATH_INFO: `/v3/users/7e44f89ee813412d9b845ff72c1df880` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:18.817261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e44f89ee813412d9b845ff72c1df880)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:18.819593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:18.822215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44013acd-ce49-4bce-87c2-25d1a43ae481 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:18.831624 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:18.833232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:18.834305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:18.834774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:18.835474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:18.837778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:18.873021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1294/2565] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:18.874525 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:18.890110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f4171-4e94-4de8-9443-0b2b941351d7 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:18.902919 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952383-a1b0-4813-a958-8c7d43746211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:18.903628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952383-a1b0-4813-a958-8c7d43746211 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:18.907096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952383-a1b0-4813-a958-8c7d43746211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:18.907506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952383-a1b0-4813-a958-8c7d43746211 admin admin] PATH_INFO: `/v3/projects/546ee64042ae4639a353c437092d1661/users/b0d254f9b23e426097963bfdd6b91c59/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:18.955749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28952383-a1b0-4813-a958-8c7d43746211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546ee64042ae4639a353c437092d1661, user_id=b0d254f9b23e426097963bfdd6b91c59, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:18.958943 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28952383-a1b0-4813-a958-8c7d43746211 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:19.060420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e44f89ee813412d9b845ff72c1df880'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.072040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:19.088381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1295/2566] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:18 2022] PUT /identity/v3/projects/546ee64042ae4639a353c437092d1661/users/b0d254f9b23e426097963bfdd6b91c59/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:19.101617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:19.102220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:19.102774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:19.157220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e44f89ee813412d9b845ff72c1df880'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.158560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e44f89ee813412d9b845ff72c1df880'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.164948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] MFA Rules not processed for user `b0d254f9b23e426097963bfdd6b91c59`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:19.166288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:19.179334 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e44f89ee813412d9b845ff72c1df880'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.197032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e44f89ee813412d9b845ff72c1df880'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.208629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1272/2567] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:18 2022] DELETE /identity/v3/users/7e44f89ee813412d9b845ff72c1df880 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:19.322124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1296/2568] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:19.328981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:19.331791 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:19.441098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3150d3-7da1-49d5-947f-26274ea19051 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:19.445918 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:19.446451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:19.446748 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:19.447033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:19.447671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:19.449725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:19.491344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:19.493257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:19.560095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1273/2569] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:19 2022] POST /identity/v3/projects => generated 403 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:19.564874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:19.577101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91aa76-e008-40f3-b2b6-7f8d3c447a7b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:19.590996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:19.644169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:19.644169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:19.644383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:19.644471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] PATH_INFO: `/v3/projects/1d6a392e19db4bac9d007bae20eddad4` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:19.645805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6a392e19db4bac9d007bae20eddad4)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:19.647894 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:19.648101 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34c3c2-8167-494f-a578-3d5d50d904b9 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:19.654745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:19.655379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:19.655665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:19.655943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:19.656594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:19.658775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:19.863840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1274/2570] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:19 2022] POST /identity/v3/users => generated 308 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:19.863840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:19.872082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438890f-6bdf-42ec-937b-d3bc6db8a2c2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:19.877511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6a392e19db4bac9d007bae20eddad4', 'request_id': 'req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.883759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6a392e19db4bac9d007bae20eddad4', 'request_id': 'req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.891625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6a392e19db4bac9d007bae20eddad4', 'request_id': 'req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.919165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:19.935886 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:19.936493 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:19.936796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:19.937067 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:19.937927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:19.939360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:19.951961 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1275/2571] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:19.955294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:19.957731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:19.975485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd61296-cc52-42b7-a926-fbb110f7d78b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:19.983944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:19.991666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:19.991666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:19.991666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] PATH_INFO: `/v3/projects/29ed7db7999643009fb49cd0a0228d6e` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:19.992004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] The token cache is being invalidate because project 1d6a392e19db4bac9d007bae20eddad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:19.992004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.992004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:19.992218 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ed7db7999643009fb49cd0a0228d6e)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:19.992307 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1297/2572] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:19 2022] DELETE /identity/v3/projects/1d6a392e19db4bac9d007bae20eddad4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:19.992388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:19.992474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:19.993498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.013489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22069ac-8c49-4f06-a1fe-c4ce8c89457f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:20.019022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:20.019664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.019938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.020231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] PATH_INFO: `/v3/projects/d4ae5d27db494ff5986d7900decec6ca/users/20e568c359dc45b5b79c8e14c6f1232f/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.039100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ae5d27db494ff5986d7900decec6ca, user_id=20e568c359dc45b5b79c8e14c6f1232f, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:20.041846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:20.231682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1298/2573] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:19 2022] PUT /identity/v3/projects/d4ae5d27db494ff5986d7900decec6ca/users/20e568c359dc45b5b79c8e14c6f1232f/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:20.241682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:20.241682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.243420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ed7db7999643009fb49cd0a0228d6e', 'request_id': 'req-15bdb761-cfaf-43e1-94c7-d3676f7e31df'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.254839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ed7db7999643009fb49cd0a0228d6e', 'request_id': 'req-15bdb761-cfaf-43e1-94c7-d3676f7e31df'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.317417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024f2f0-72e8-4c3f-8167-b3314841b72f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:20.389971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:20.390622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.390907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.391180 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] PATH_INFO: `/v3/users/0e8c169a96a14258bb8fc1f0357654ba` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.392480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8c169a96a14258bb8fc1f0357654ba)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:20.394583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:20.430529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ed7db7999643009fb49cd0a0228d6e', 'request_id': 'req-15bdb761-cfaf-43e1-94c7-d3676f7e31df'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.445163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] The token cache is being invalidate because project 29ed7db7999643009fb49cd0a0228d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:20.445451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.447750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.447750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1276/2574] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:19 2022] DELETE /identity/v3/projects/29ed7db7999643009fb49cd0a0228d6e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:20.448448 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:20.450623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.466175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb761-cfaf-43e1-94c7-d3676f7e31df admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:20.471214 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79d002-209a-43e5-9fb6-06cb79895592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:20.471835 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79d002-209a-43e5-9fb6-06cb79895592 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.472115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79d002-209a-43e5-9fb6-06cb79895592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.472386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79d002-209a-43e5-9fb6-06cb79895592 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.473076 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79d002-209a-43e5-9fb6-06cb79895592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:20.474887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79d002-209a-43e5-9fb6-06cb79895592 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:20.486367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1277/2575] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:20.487923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63ae4c-15c0-4539-8e83-afa271518bb0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.488215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63ae4c-15c0-4539-8e83-afa271518bb0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.488481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63ae4c-15c0-4539-8e83-afa271518bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.509824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-db63ae4c-15c0-4539-8e83-afa271518bb0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:20.511134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-db63ae4c-15c0-4539-8e83-afa271518bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.520425 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1278/2576] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:20.521370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63ae4c-15c0-4539-8e83-afa271518bb0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:20.536014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63ae4c-15c0-4539-8e83-afa271518bb0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:20.541162 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef6c76-6ea1-418f-b17b-9e7770f7e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:20.541850 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6c76-6ea1-418f-b17b-9e7770f7e880 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.542126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6c76-6ea1-418f-b17b-9e7770f7e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.542396 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6c76-6ea1-418f-b17b-9e7770f7e880 admin admin] PATH_INFO: `/v3/projects/d4ae5d27db494ff5986d7900decec6ca/users/20e568c359dc45b5b79c8e14c6f1232f/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.544780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef6c76-6ea1-418f-b17b-9e7770f7e880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ae5d27db494ff5986d7900decec6ca, user_id=20e568c359dc45b5b79c8e14c6f1232f, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:20.547485 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef6c76-6ea1-418f-b17b-9e7770f7e880 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:20.560949 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1279/2577] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:20 2022] PUT /identity/v3/projects/d4ae5d27db494ff5986d7900decec6ca/users/20e568c359dc45b5b79c8e14c6f1232f/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:20.563151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0dbeb-087b-4292-9152-a9cff332f3e6 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.563990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0dbeb-087b-4292-9152-a9cff332f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.564441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0dbeb-087b-4292-9152-a9cff332f3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.594511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-bae0dbeb-087b-4292-9152-a9cff332f3e6 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:20.595768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bae0dbeb-087b-4292-9152-a9cff332f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.643144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:20.683031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1280/2578] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:20.685028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.685342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.685603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.720854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] MFA Rules not processed for user `20e568c359dc45b5b79c8e14c6f1232f`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:20.721813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.735383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8c169a96a14258bb8fc1f0357654ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.736128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8c169a96a14258bb8fc1f0357654ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.804384 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1281/2579] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:20 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:20.805429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:20.806880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.825035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8c169a96a14258bb8fc1f0357654ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.832156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8c169a96a14258bb8fc1f0357654ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.832307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f578dc-93e9-458a-ba13-d7538e7e0898 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:20.833777 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8c169a96a14258bb8fc1f0357654ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:20.835546 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735e93-f0b4-4aa3-bfcc-a3b677aa455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:20.836153 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735e93-f0b4-4aa3-bfcc-a3b677aa455c admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.836436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735e93-f0b4-4aa3-bfcc-a3b677aa455c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.836856 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735e93-f0b4-4aa3-bfcc-a3b677aa455c admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.837610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735e93-f0b4-4aa3-bfcc-a3b677aa455c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:20.837955 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735e93-f0b4-4aa3-bfcc-a3b677aa455c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:20.840505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735e93-f0b4-4aa3-bfcc-a3b677aa455c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:20.854275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1282/2580] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:36:20.858037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e66f-e88a-44f0-91ef-5eff7cbfd0a9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.858212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e66f-e88a-44f0-91ef-5eff7cbfd0a9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.859136 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e66f-e88a-44f0-91ef-5eff7cbfd0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.861513 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1299/2581] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:20 2022] DELETE /identity/v3/users/0e8c169a96a14258bb8fc1f0357654ba => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:20.862386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:20.863926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.885437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0532e66f-e88a-44f0-91ef-5eff7cbfd0a9 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:20.886984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0532e66f-e88a-44f0-91ef-5eff7cbfd0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:20.957466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1283/2582] 10.222.0.71 () {58 vars in 967 bytes} [Fri Sep 2 21:36:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:20.958371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e66f-e88a-44f0-91ef-5eff7cbfd0a9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:20.963338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d4dc6-867e-4098-b39b-26b675307b25 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:20.969406 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:20.970254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:20.971300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:20.971794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:20.982984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:21.040988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532e66f-e88a-44f0-91ef-5eff7cbfd0a9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:21.043828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:21.049088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:21.049317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:21.049317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:21.049317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:21.049317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:21.049937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:21.050245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:21.056921 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1300/2583] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:20 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:21.057884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:21.060600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:21.181365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f6fa-d295-4028-8848-654e0244d806 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:21.188017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:21.188675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:21.188986 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:21.189471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:21.209999 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:21.211639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:21.228350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1301/2584] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:36:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:36:21.233182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1284/2585] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:20 2022] POST /identity/v3/projects => generated 401 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:21.239046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:21.258382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57fca5-c585-40eb-9775-1682546fc8e5 service swift] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:21.268111 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:21.270426 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:21.330700 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:21.331151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:21.331396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:21.331818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:21.332293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:21.334271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:21.352257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4025fb-07ae-42e8-b5d7-22d5ea7b3592 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:21.357947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:21.358602 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:21.358891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:21.359264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] PATH_INFO: `/v3/users/b0d254f9b23e426097963bfdd6b91c59` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:21.360628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d254f9b23e426097963bfdd6b91c59)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:21.362718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:21.560215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:21.568159 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1302/2586] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:21 2022] POST /identity/v3/users => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:21.569098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:21.570739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:21.588158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e55fc-3b0f-4cc3-902f-089eb192c72f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:21.588370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:21.588981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:21.589266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:21.590047 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] PATH_INFO: `/v3/projects/d910185ba44a4d1daf6e7b35ce05d609` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:21.591269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d910185ba44a4d1daf6e7b35ce05d609)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:21.593337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:21.810497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d254f9b23e426097963bfdd6b91c59'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.816321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd910185ba44a4d1daf6e7b35ce05d609', 'request_id': 'req-429f2519-0544-46b2-98f0-9e4b6ca937a2'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.821900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd910185ba44a4d1daf6e7b35ce05d609', 'request_id': 'req-429f2519-0544-46b2-98f0-9e4b6ca937a2'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.829998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd910185ba44a4d1daf6e7b35ce05d609', 'request_id': 'req-429f2519-0544-46b2-98f0-9e4b6ca937a2'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.899601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d254f9b23e426097963bfdd6b91c59'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.900657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d254f9b23e426097963bfdd6b91c59'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.914963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d254f9b23e426097963bfdd6b91c59'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.923170 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:21.925253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d254f9b23e426097963bfdd6b91c59'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:21.931187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1285/2587] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:21 2022] DELETE /identity/v3/users/b0d254f9b23e426097963bfdd6b91c59 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:21.932888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:21.935139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.003447 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a834-9078-425e-83a6-952813c53770 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.003743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] The token cache is being invalidate because project d910185ba44a4d1daf6e7b35ce05d609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:22.004409 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:22.004717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-429f2519-0544-46b2-98f0-9e4b6ca937a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:22.006265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1303/2588] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:21 2022] DELETE /identity/v3/projects/d910185ba44a4d1daf6e7b35ce05d609 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:22.010109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.010109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.010109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.012508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fa76e-2ccb-4735-9057-443b778ce661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.013167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa76e-2ccb-4735-9057-443b778ce661 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.013564 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa76e-2ccb-4735-9057-443b778ce661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.013831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa76e-2ccb-4735-9057-443b778ce661 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.014478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fa76e-2ccb-4735-9057-443b778ce661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.016093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fa76e-2ccb-4735-9057-443b778ce661 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.028594 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1286/2589] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:22.032308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:22.032442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.032442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.032442 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.039416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.044151 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1304/2590] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:22.046113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.051864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:22.053160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.054318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.063262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1287/2591] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:22.064091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.065704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.075004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb85e8-2ab5-4f33-a807-79d283325eb5 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.079959 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a3055-2ec7-44fa-8357-5d6c69e8b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.080435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3055-2ec7-44fa-8357-5d6c69e8b134 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.080714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3055-2ec7-44fa-8357-5d6c69e8b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.081061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3055-2ec7-44fa-8357-5d6c69e8b134 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.081774 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a3055-2ec7-44fa-8357-5d6c69e8b134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.083405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a3055-2ec7-44fa-8357-5d6c69e8b134 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.094691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1305/2592] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:22.095973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7ada-33c8-400e-b3c3-273d500ed79f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.096342 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7ada-33c8-400e-b3c3-273d500ed79f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.096535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7ada-33c8-400e-b3c3-273d500ed79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.118039 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a9bd7ada-33c8-400e-b3c3-273d500ed79f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:22.119281 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a9bd7ada-33c8-400e-b3c3-273d500ed79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.128431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1306/2593] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:22.129457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7ada-33c8-400e-b3c3-273d500ed79f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.133207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df03d7-9863-4620-9dcd-92030a9c138d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.137806 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.138464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.138772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.139051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.142710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7ada-33c8-400e-b3c3-273d500ed79f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.147639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451113d1-280f-418a-91bd-1ef7b82ac303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.148305 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451113d1-280f-418a-91bd-1ef7b82ac303 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.148594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451113d1-280f-418a-91bd-1ef7b82ac303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.148909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451113d1-280f-418a-91bd-1ef7b82ac303 admin admin] PATH_INFO: `/v3/projects/4b50dba5a5b84026885e5943393e877f/users/66ec8df33260416ab1828cf413ddf813/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.149423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.151144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.162401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1288/2594] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:22.163286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.186369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:22.186369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451113d1-280f-418a-91bd-1ef7b82ac303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b50dba5a5b84026885e5943393e877f, user_id=66ec8df33260416ab1828cf413ddf813, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.186369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451113d1-280f-418a-91bd-1ef7b82ac303 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.186927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd185a5-22b6-40c0-bf47-ff63a0fd0807 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.186927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.186927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.186927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.187284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.187284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:22.187284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.187284 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.197771 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1289/2595] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:36:22.202980 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.215734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:22.218857 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7bea-9d7a-4223-87c4-fbce7118627f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.223814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.224438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.224717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.225015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.225650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.227580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.249729 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1307/2596] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:22 2022] PUT /identity/v3/projects/4b50dba5a5b84026885e5943393e877f/users/66ec8df33260416ab1828cf413ddf813/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:22.260836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b9a3-0eca-40ba-8d23-fa94b920e96e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.261201 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b9a3-0eca-40ba-8d23-fa94b920e96e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.261515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b9a3-0eca-40ba-8d23-fa94b920e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.294675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a260b9a3-0eca-40ba-8d23-fa94b920e96e None None] MFA Rules not processed for user `66ec8df33260416ab1828cf413ddf813`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:22.295998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a260b9a3-0eca-40ba-8d23-fa94b920e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.365637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1290/2597] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:22.369696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.380957 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1308/2598] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:22.381702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b9a3-0eca-40ba-8d23-fa94b920e96e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.447761 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb74b-e929-4ed2-b637-d915b3016f88 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.456367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.457043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.457329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.457614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.458265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.460400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.479731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b9a3-0eca-40ba-8d23-fa94b920e96e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.485542 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.486134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.486586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.488053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.488053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.489538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.574691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1291/2599] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:22.579071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.589192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5ced9-ddc1-46da-b515-69aa0484d1b5 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.595580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.596587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.596922 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.597194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.598145 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.599854 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.609590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1309/2600] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/projects => generated 401 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:22.610990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.613274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1292/2601] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:22.617709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.629445 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca03da-a7ea-4bd3-9ee2-ef2b74531b23 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.680702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e7ed0-041e-426d-a170-69bc7e1654f3 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.686724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.687333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.687615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.687881 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.688606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.690559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.702274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.702887 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.703197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.703517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.704260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.706004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.720571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1293/2602] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:22.721528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.732161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50a08-6242-4edf-a60e-69fd5863aefc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.748969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.748969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.748969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.748969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] PATH_INFO: `/v3/projects/1220a722698b4286a5a60e17115b1372/users/d994e5c901e7400baf2c5ef5e1a859f3/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.765233 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1220a722698b4286a5a60e17115b1372, user_id=d994e5c901e7400baf2c5ef5e1a859f3, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.767398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.809301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1310/2603] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/users => generated 307 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:22.810740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.812680 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:22.825544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488826c7-04ec-413f-b136-f433f24cb715 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.831344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.834645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.834645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.834645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] PATH_INFO: `/v3/projects/546ee64042ae4639a353c437092d1661` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.834645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=546ee64042ae4639a353c437092d1661)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.835260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.866951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1294/2604] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:22 2022] PUT /identity/v3/projects/1220a722698b4286a5a60e17115b1372/users/d994e5c901e7400baf2c5ef5e1a859f3/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:22.866951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:22.922068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:22.940244 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754cb1c-cbed-4eb1-958e-b3b59571b55f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:22.945395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebd404-d460-47a8-a793-99966996b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:22.946077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebd404-d460-47a8-a793-99966996b33b admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.946343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebd404-d460-47a8-a793-99966996b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.946607 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebd404-d460-47a8-a793-99966996b33b admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.947258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebd404-d460-47a8-a793-99966996b33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:22.949008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebd404-d460-47a8-a793-99966996b33b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:22.961385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1295/2605] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:22.963311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:22.963797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:22.964285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:22.965356 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546ee64042ae4639a353c437092d1661', 'request_id': 'req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:22.973351 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546ee64042ae4639a353c437092d1661', 'request_id': 'req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:22.985650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546ee64042ae4639a353c437092d1661', 'request_id': 'req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.000698 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] MFA Rules not processed for user `d994e5c901e7400baf2c5ef5e1a859f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:23.001990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.081382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] The token cache is being invalidate because project 546ee64042ae4639a353c437092d1661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:23.081382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.081382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.081382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1311/2606] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:22 2022] DELETE /identity/v3/projects/546ee64042ae4639a353c437092d1661 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:23.081382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:23.082591 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.090316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:23.103898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1296/2607] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:23.103898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:23.103898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.175808 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaa3d4-150c-4eed-8e89-d4ad0dfbb2ce admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:23.182549 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:23.183380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.185703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.185703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] PATH_INFO: `/v3/projects/c0093653542e4fab971f8cb6b27b1d32/users/42f161e1b32040b68a7d545a20c47d8b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.202037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0093653542e4fab971f8cb6b27b1d32, user_id=42f161e1b32040b68a7d545a20c47d8b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:23.205617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:23.212124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6b66-b7a7-491f-8ab0-0e0a9b5ae618 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:23.219952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:23.220595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.220906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.221182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] PATH_INFO: `/v3/users/20e568c359dc45b5b79c8e14c6f1232f` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.222350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e568c359dc45b5b79c8e14c6f1232f)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:23.224378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:23.300839 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1312/2608] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:23 2022] PUT /identity/v3/projects/c0093653542e4fab971f8cb6b27b1d32/users/42f161e1b32040b68a7d545a20c47d8b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:23.302474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:23.304116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.366783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9358-9905-4438-9692-0a06483d4867 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:23.372923 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:23.373606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.373886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.374186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.386712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:23.404224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e568c359dc45b5b79c8e14c6f1232f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.443654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:23.445099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:23.456102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1313/2609] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:23.466803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:23.491826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e568c359dc45b5b79c8e14c6f1232f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.492693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e568c359dc45b5b79c8e14c6f1232f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.501208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:23.513347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e568c359dc45b5b79c8e14c6f1232f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.524530 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e568c359dc45b5b79c8e14c6f1232f'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.533976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1297/2610] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:23 2022] DELETE /identity/v3/users/20e568c359dc45b5b79c8e14c6f1232f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:23.534858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:23.536267 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.538970 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a3570-3855-4d5b-9c1f-c9b11edc660c service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:23.623871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9cce6-27f0-4de4-a1a5-d2add1655da3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:23.630519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:23.631329 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.631903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.632248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] PATH_INFO: `/v3/users/d994e5c901e7400baf2c5ef5e1a859f3` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.633925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d994e5c901e7400baf2c5ef5e1a859f3)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:23.636616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:23.639259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:23.640805 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.641410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.642291 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.643144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:23.645510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:23.657914 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1314/2611] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:23.662296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:23.664216 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.678758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d48453-36df-4de8-9a8c-f055dcaf9a18 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:23.685080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5528b-6653-4d32-ac8a-47289997f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:23.685761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5528b-6653-4d32-ac8a-47289997f2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.686083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5528b-6653-4d32-ac8a-47289997f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.687727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5528b-6653-4d32-ac8a-47289997f2b7 admin admin] PATH_INFO: `/v3/projects/c0093653542e4fab971f8cb6b27b1d32/users/42f161e1b32040b68a7d545a20c47d8b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.688501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5528b-6653-4d32-ac8a-47289997f2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0093653542e4fab971f8cb6b27b1d32, user_id=42f161e1b32040b68a7d545a20c47d8b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:23.691119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5528b-6653-4d32-ac8a-47289997f2b7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:23.705981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1315/2612] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:23 2022] PUT /identity/v3/projects/c0093653542e4fab971f8cb6b27b1d32/users/42f161e1b32040b68a7d545a20c47d8b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:23.717202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.717489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.718070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.751347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] MFA Rules not processed for user `42f161e1b32040b68a7d545a20c47d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:23.752597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.839482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1316/2613] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:23.848343 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd994e5c901e7400baf2c5ef5e1a859f3'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.853167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:23.854632 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:23.930757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440bb5d-4a0d-4d7d-bc35-41eef300732e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:23.936371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f46a0-c191-4730-8bf1-987860d79060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:23.937662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f46a0-c191-4730-8bf1-987860d79060 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.937844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f46a0-c191-4730-8bf1-987860d79060 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.938259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f46a0-c191-4730-8bf1-987860d79060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:23.948626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f46a0-c191-4730-8bf1-987860d79060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:23.950944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f46a0-c191-4730-8bf1-987860d79060 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:23.951549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd994e5c901e7400baf2c5ef5e1a859f3'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.952351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd994e5c901e7400baf2c5ef5e1a859f3'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.962232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1317/2614] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:23.967266 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd994e5c901e7400baf2c5ef5e1a859f3'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.975260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd994e5c901e7400baf2c5ef5e1a859f3'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:23.979719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:23.983624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1298/2615] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:23 2022] DELETE /identity/v3/users/d994e5c901e7400baf2c5ef5e1a859f3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:23.988835 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:23.989303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:23.989751 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.013468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:24.017365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.069872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:24.072117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.097431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1318/2616] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:24.112263 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:24.114504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.123691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:24.179401 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bb1d-7fad-4c00-82b5-ca6e7e4b6f8f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:24.186364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:24.187028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:24.187310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:24.187588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] PATH_INFO: `/v3/projects/d4ae5d27db494ff5986d7900decec6ca` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.188950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ae5d27db494ff5986d7900decec6ca)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:24.190920 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:24.208306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2d576-4f62-46b9-b6e0-49fbe9752283 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:24.218410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:24.218410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:24.218410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:24.218410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.232020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:24.233566 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:24.245104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1319/2617] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:24.271604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:24.273100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.334790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c31cb-284b-49ca-8c05-e61b4ee8c75b service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:24.339222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7091d-16ed-4a77-9d49-4d9d0919cb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:24.339449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7091d-16ed-4a77-9d49-4d9d0919cb49 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:24.339539 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7091d-16ed-4a77-9d49-4d9d0919cb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:24.339810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7091d-16ed-4a77-9d49-4d9d0919cb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.342765 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-29e7091d-16ed-4a77-9d49-4d9d0919cb49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.390387 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ae5d27db494ff5986d7900decec6ca', 'request_id': 'req-b17d7664-31bc-407f-910d-da2bf4dfdc07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:24.398290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ae5d27db494ff5986d7900decec6ca', 'request_id': 'req-b17d7664-31bc-407f-910d-da2bf4dfdc07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:24.429848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7091d-16ed-4a77-9d49-4d9d0919cb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:24.431507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7091d-16ed-4a77-9d49-4d9d0919cb49 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:24.443866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1320/2618] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:24.471161 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ae5d27db494ff5986d7900decec6ca', 'request_id': 'req-b17d7664-31bc-407f-910d-da2bf4dfdc07'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:24.486373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] The token cache is being invalidate because project d4ae5d27db494ff5986d7900decec6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:24.486877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:24.487793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b17d7664-31bc-407f-910d-da2bf4dfdc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:24.494818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1299/2619] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:24 2022] DELETE /identity/v3/projects/d4ae5d27db494ff5986d7900decec6ca => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:24.496269 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b3c4e-0eb2-445e-a378-6e9e539ed3ca None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:24.496574 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b3c4e-0eb2-445e-a378-6e9e539ed3ca None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:24.497015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b3c4e-0eb2-445e-a378-6e9e539ed3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.503590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:24.521029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e07b3c4e-0eb2-445e-a378-6e9e539ed3ca None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:24.521593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e07b3c4e-0eb2-445e-a378-6e9e539ed3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.595610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1321/2620] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:24.603148 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389a05-36eb-4d99-a969-36e56458fe3e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:24.605845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389a05-36eb-4d99-a969-36e56458fe3e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:24.605845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b389a05-36eb-4d99-a969-36e56458fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.632436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-0b389a05-36eb-4d99-a969-36e56458fe3e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:24.633730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0b389a05-36eb-4d99-a969-36e56458fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.649253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1300/2621] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:24.650353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b3c4e-0eb2-445e-a378-6e9e539ed3ca None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:24.683544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b3c4e-0eb2-445e-a378-6e9e539ed3ca None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:24.695844 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:24.698150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:24.698628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:24.699086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.699932 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:24.700564 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:24.709329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:24.734978 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1322/2622] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:36:24.739714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b389a05-36eb-4d99-a969-36e56458fe3e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:24.749950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b389a05-36eb-4d99-a969-36e56458fe3e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:24.756295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:24.757124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:24.757432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:24.757705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:24.758354 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:24.760308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:24.884395 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:24.886864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:24.891519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1301/2623] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:24 2022] POST /identity/v3/projects => generated 357 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:24.897250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:24.904516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68f363-c45e-48ae-aeb0-1b1faafe7875 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:24.932387 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:25.104533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:25.104533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.104533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.104533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] PATH_INFO: `/v3/projects/1220a722698b4286a5a60e17115b1372` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.106480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1220a722698b4286a5a60e17115b1372)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:25.106480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:25.106989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85edae-265b-40d1-88ea-a13b7ba6b5d0 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:25.106989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:25.106989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.106989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.107624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.107624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:25.107624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:25.294149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1302/2624] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:24 2022] POST /identity/v3/users => generated 279 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:25.304371 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:25.315536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b370c42-aaed-4bac-b5e8-67406820bf60 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:25.320242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:25.320899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.321330 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.321612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.322315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:25.324599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:25.336429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1303/2625] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:25.343141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:25.352693 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1220a722698b4286a5a60e17115b1372', 'request_id': 'req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.357889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:25.358929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1220a722698b4286a5a60e17115b1372', 'request_id': 'req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.362873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841de129-5868-4e26-955e-ca6fde3f1876 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:25.369148 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1220a722698b4286a5a60e17115b1372', 'request_id': 'req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.423307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:25.423921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.424200 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.424480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.425164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:25.431369 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:25.438164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1304/2626] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:25.439056 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:25.441271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:25.455139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d022-f1e1-42b4-b4d9-76e66147e3c5 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:25.460394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:25.462222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.462222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.462222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] PATH_INFO: `/v3/users/af6b0e2ea8284f7c80a1f138dc2ff4cc` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.462867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6b0e2ea8284f7c80a1f138dc2ff4cc)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:25.464959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:25.488055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] The token cache is being invalidate because project 1220a722698b4286a5a60e17115b1372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:25.488378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.489214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.497354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1323/2627] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:24 2022] DELETE /identity/v3/projects/1220a722698b4286a5a60e17115b1372 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:25.497354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:25.497354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:25.508472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4750f2-4f4b-47f3-aa6f-cd8525291f9d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:25.513767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023715ca-95ef-4bcf-aad8-32ea4cf1c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:25.514458 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023715ca-95ef-4bcf-aad8-32ea4cf1c90f admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.514732 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023715ca-95ef-4bcf-aad8-32ea4cf1c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.515365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023715ca-95ef-4bcf-aad8-32ea4cf1c90f admin admin] PATH_INFO: `/v3/projects/fa855ea427384f22814513dc9f3bb5c2/users/aa72653d77e746d7bf3970a85de93ee8/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.539131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023715ca-95ef-4bcf-aad8-32ea4cf1c90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa855ea427384f22814513dc9f3bb5c2, user_id=aa72653d77e746d7bf3970a85de93ee8, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:25.539131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023715ca-95ef-4bcf-aad8-32ea4cf1c90f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:25.731141 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1324/2628] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:25 2022] PUT /identity/v3/projects/fa855ea427384f22814513dc9f3bb5c2/users/aa72653d77e746d7bf3970a85de93ee8/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:25.732850 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e442-bd36-4bbe-ae6b-4df5f0372302 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.733135 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e442-bd36-4bbe-ae6b-4df5f0372302 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.733748 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e442-bd36-4bbe-ae6b-4df5f0372302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.759678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4aa9e442-bd36-4bbe-ae6b-4df5f0372302 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:25.760652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4aa9e442-bd36-4bbe-ae6b-4df5f0372302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:25.795059 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6b0e2ea8284f7c80a1f138dc2ff4cc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.831179 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1325/2629] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:25.832611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66530-57ce-4376-aeaf-1ea3ff8f47af None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.832930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66530-57ce-4376-aeaf-1ea3ff8f47af None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.833205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66530-57ce-4376-aeaf-1ea3ff8f47af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.862907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-d0f66530-57ce-4376-aeaf-1ea3ff8f47af None None] MFA Rules not processed for user `aa72653d77e746d7bf3970a85de93ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:25.866031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d0f66530-57ce-4376-aeaf-1ea3ff8f47af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:25.916042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6b0e2ea8284f7c80a1f138dc2ff4cc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.918220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6b0e2ea8284f7c80a1f138dc2ff4cc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.918346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:25.930294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6b0e2ea8284f7c80a1f138dc2ff4cc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.938544 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6b0e2ea8284f7c80a1f138dc2ff4cc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:25.939084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1326/2630] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:25.940223 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372858b-f8f9-4289-a856-5bbcdf2973c6 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:25.940511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372858b-f8f9-4289-a856-5bbcdf2973c6 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:25.940819 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372858b-f8f9-4289-a856-5bbcdf2973c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:25.948708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1305/2631] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:25 2022] DELETE /identity/v3/users/af6b0e2ea8284f7c80a1f138dc2ff4cc => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:25.950186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:25.951332 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:25.961185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0372858b-f8f9-4289-a856-5bbcdf2973c6 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:25.962554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0372858b-f8f9-4289-a856-5bbcdf2973c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:26.045209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1327/2632] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:26.046097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14aba0-52f1-4f70-8d29-216431717098 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.049753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372858b-f8f9-4289-a856-5bbcdf2973c6 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.051666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.052509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.053028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.053503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.054331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.056460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.059843 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372858b-f8f9-4289-a856-5bbcdf2973c6 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.068895 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.077092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.077092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.077092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.077092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:26.077092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.077092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.090831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1328/2633] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:36:26.093504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.106264 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ac2e7-620f-4fc1-94eb-7fc5ecf157b4 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.111302 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.111915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.112684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.112684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.113143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.115112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.188357 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1306/2634] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:25 2022] POST /identity/v3/projects => generated 355 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:26.192667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.263379 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1329/2635] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:26 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:26.264778 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.266910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0debc7d-ff94-400e-bcb1-e3a9dd9cfe31 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.339225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.340776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.341203 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.341460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.342107 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.344075 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.347246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbcc30-5190-4629-be9c-cd7f146b4e38 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.352811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.353438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.353718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.353993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.354662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.357629 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.420675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1307/2636] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:26 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:26.421553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.423253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:26.435766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1330/2637] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:26 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:26.435766 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.436497 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbec01-fd58-4d9a-be66-5f00f8a2652b admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.442134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.442776 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.443058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.443331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] PATH_INFO: `/v3/projects/71182b7ab01a4591b9187a31345bc1f4` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.444471 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71182b7ab01a4591b9187a31345bc1f4)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.446276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7774f-86e0-4018-bd4b-03e4cb13127d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.446482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.451348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.451958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.452231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.452504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.453309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.454968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.465668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1331/2638] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:26.466580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.477158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a14627-7fb4-427b-a386-1606cae529a6 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.482883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.483485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.483839 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.484087 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.484737 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.486357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.511270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1332/2639] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:26.512276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.536285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b834bd-6634-4349-950c-d5ed2db92bfa admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.541226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.541882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.542163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.543030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] PATH_INFO: `/v3/projects/bd126824ced347d291e7ea3ceb28d085/users/0fb149bdb66c47559dfc15f98d91b883/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.559882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd126824ced347d291e7ea3ceb28d085, user_id=0fb149bdb66c47559dfc15f98d91b883, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.562866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.570636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71182b7ab01a4591b9187a31345bc1f4', 'request_id': 'req-bf1ebea3-43de-48a8-bf3c-b8818177e29c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:26.578157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71182b7ab01a4591b9187a31345bc1f4', 'request_id': 'req-bf1ebea3-43de-48a8-bf3c-b8818177e29c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:26.653181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71182b7ab01a4591b9187a31345bc1f4', 'request_id': 'req-bf1ebea3-43de-48a8-bf3c-b8818177e29c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:26.660289 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1333/2640] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:26 2022] PUT /identity/v3/projects/bd126824ced347d291e7ea3ceb28d085/users/0fb149bdb66c47559dfc15f98d91b883/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:26.661435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.667274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] The token cache is being invalidate because project 71182b7ab01a4591b9187a31345bc1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:26.668070 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:26.668790 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:26.670517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1308/2641] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:26 2022] DELETE /identity/v3/projects/71182b7ab01a4591b9187a31345bc1f4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:26.671482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.672983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:26.758346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d178c-5e62-4dd1-8cd4-3a195d6a9511 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.760490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ebea3-43de-48a8-bf3c-b8818177e29c admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.765294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.765849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.766137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.766511 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.767099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.767226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.767758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.768039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.768311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.768823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.769008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.770773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.786459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1309/2642] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:26.787580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.792668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1334/2643] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:26.794588 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.796526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:26.800004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62b611-446b-4b62-a51d-6a0ab25ff8fb admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.804992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e75005-24b1-41f2-8dd0-2d00fc43594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.805677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75005-24b1-41f2-8dd0-2d00fc43594b admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.805962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75005-24b1-41f2-8dd0-2d00fc43594b admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.806253 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75005-24b1-41f2-8dd0-2d00fc43594b admin admin] PATH_INFO: `/v3/projects/bd126824ced347d291e7ea3ceb28d085/users/0fb149bdb66c47559dfc15f98d91b883/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.808825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e75005-24b1-41f2-8dd0-2d00fc43594b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd126824ced347d291e7ea3ceb28d085, user_id=0fb149bdb66c47559dfc15f98d91b883, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.811527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e75005-24b1-41f2-8dd0-2d00fc43594b admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.813259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abc41-bfe2-44b7-99e6-706d4f5e9335 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:26.818337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:26.819022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.819306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.819584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] PATH_INFO: `/v3/projects/029ec67b979047b7bab7b9b3eff38fae/users/ac5323b2db6f4a7c9a3963d042275010/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.824765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1310/2644] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:26 2022] PUT /identity/v3/projects/bd126824ced347d291e7ea3ceb28d085/users/0fb149bdb66c47559dfc15f98d91b883/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:26.838128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=029ec67b979047b7bab7b9b3eff38fae, user_id=ac5323b2db6f4a7c9a3963d042275010, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:26.841443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:26.844374 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ab31-f0d8-4bdb-aa1b-1e44f2b24364 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.844779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ab31-f0d8-4bdb-aa1b-1e44f2b24364 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.845186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ab31-f0d8-4bdb-aa1b-1e44f2b24364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.888283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2ad8ab31-f0d8-4bdb-aa1b-1e44f2b24364 None None] MFA Rules not processed for user `0fb149bdb66c47559dfc15f98d91b883`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:26.889578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2ad8ab31-f0d8-4bdb-aa1b-1e44f2b24364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:26.973064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1311/2645] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:26.977391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1335/2646] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:26 2022] PUT /identity/v3/projects/029ec67b979047b7bab7b9b3eff38fae/users/ac5323b2db6f4a7c9a3963d042275010/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:26.984243 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ecc87-551f-4146-b8f9-2fbb2f742c64 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:26.984531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ecc87-551f-4146-b8f9-2fbb2f742c64 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:26.984834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ecc87-551f-4146-b8f9-2fbb2f742c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:26.987976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:26.990246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:27.008486 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:27.017665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-338ecc87-551f-4146-b8f9-2fbb2f742c64 None None] MFA Rules not processed for user `ac5323b2db6f4a7c9a3963d042275010`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:27.024449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-338ecc87-551f-4146-b8f9-2fbb2f742c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:27.049897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92f2ef-29b7-4d7b-8d3a-f3002e7ea25b admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.051920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.052520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.052840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.053110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.086911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1312/2647] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:27.091501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ecc87-551f-4146-b8f9-2fbb2f742c64 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:27.115742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.117240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:27.127602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1336/2648] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:27.157325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ecc87-551f-4146-b8f9-2fbb2f742c64 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.162187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.170538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:27.170709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.170709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.170709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.170709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.170709 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:27.330583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1313/2649] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:27.340319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:27.351247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0df84-b3af-4ea5-bb34-8631dd60738f service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.409219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.409845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.410129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.410408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.411045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.413097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:27.417049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:27.475667 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573989f-5845-42ad-918f-cde0c73eacf8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.479370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.480617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.481014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.481293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.483061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:27.505346 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1337/2650] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:27 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:27.509472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:27.520676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250125f-fe7c-4de1-a645-1a584b450462 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.526029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.526670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.527471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.527749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.528454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.530124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:27.541695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1338/2651] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:27.547031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:27.555534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.555534 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:27.558210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97b9c-943e-4344-835e-a19f98c2f9fc admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.558792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1314/2652] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:27.563452 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf016f-0e44-4893-9284-351c9de364e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.564133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf016f-0e44-4893-9284-351c9de364e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.564323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf016f-0e44-4893-9284-351c9de364e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.564888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf016f-0e44-4893-9284-351c9de364e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.565418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf016f-0e44-4893-9284-351c9de364e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.567092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf016f-0e44-4893-9284-351c9de364e2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:27.578366 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1339/2653] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:27.582731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:27.594524 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2160-d9f6-48f7-9c28-9dc253c83cf6 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.599482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.600342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.600622 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.601026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] PATH_INFO: `/v3/projects/029114f4ea994a07806117d1141689e3/users/2333dfb23201425dbdda58d2f49213ad/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.616784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029114f4ea994a07806117d1141689e3, user_id=2333dfb23201425dbdda58d2f49213ad, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.619438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:27.762563 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1315/2654] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:27 2022] PUT /identity/v3/projects/029114f4ea994a07806117d1141689e3/users/2333dfb23201425dbdda58d2f49213ad/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:27.773147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5270f-4b18-4d5e-80f9-1c0613cd7fa4 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.773481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5270f-4b18-4d5e-80f9-1c0613cd7fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.773705 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5270f-4b18-4d5e-80f9-1c0613cd7fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.805187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-28e5270f-4b18-4d5e-80f9-1c0613cd7fa4 None None] MFA Rules not processed for user `2333dfb23201425dbdda58d2f49213ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:27.807682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-28e5270f-4b18-4d5e-80f9-1c0613cd7fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:27.876234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1340/2655] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:27.880669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:27.944939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d97372-b44f-47dd-8f61-9d53bb6e72b0 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:27.950119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:27.950731 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:27.951013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:27.951289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:27.951941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:27.953998 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:28.002806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:28.127222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1316/2656] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:28.128893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5270f-4b18-4d5e-80f9-1c0613cd7fa4 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:28.140401 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5270f-4b18-4d5e-80f9-1c0613cd7fa4 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:28.199029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:28.199857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:28.200120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:28.200399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:28.201089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:28.203338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:28.258966 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:28.351434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1341/2657] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:28 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:28.356614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:28.366800 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494a1d-72d0-4386-8431-ad7df0c0b62a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:28.371711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:28.372411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:28.372694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:28.372993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:28.373640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:28.375373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:28.388785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1317/2658] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:28.390961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:28.401218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e794f4-3954-45fd-b087-38f5d1495331 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:28.408590 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:28.409696 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:28.410123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:28.410576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] PATH_INFO: `/v3/projects/22de2d9f56684460a9c3391c45d9aa1e/users/f2d6353e2d804e23b70e032a6632fed9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:28.429763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22de2d9f56684460a9c3391c45d9aa1e, user_id=f2d6353e2d804e23b70e032a6632fed9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:28.432648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:28.559527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1342/2659] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:28 2022] PUT /identity/v3/projects/22de2d9f56684460a9c3391c45d9aa1e/users/f2d6353e2d804e23b70e032a6632fed9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:28.563579 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:28.574470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c19aac-a1ed-48cf-b16a-cabd71b87a34 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:28.633094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8626e3d-45fb-492a-9cd1-5d3c5e37afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:28.633715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8626e3d-45fb-492a-9cd1-5d3c5e37afaa admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:28.633996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8626e3d-45fb-492a-9cd1-5d3c5e37afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:28.634274 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8626e3d-45fb-492a-9cd1-5d3c5e37afaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:28.634917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8626e3d-45fb-492a-9cd1-5d3c5e37afaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:28.637365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8626e3d-45fb-492a-9cd1-5d3c5e37afaa admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:28.647535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1318/2660] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:28.652012 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:28.663476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f15bc-62ee-40b5-9dec-2230e561ec09 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:28.668811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:28.669472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:28.669754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:28.670158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] PATH_INFO: `/v3/projects/22de2d9f56684460a9c3391c45d9aa1e/users/f2d6353e2d804e23b70e032a6632fed9/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:28.672175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22de2d9f56684460a9c3391c45d9aa1e, user_id=f2d6353e2d804e23b70e032a6632fed9, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:28.674870 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:28.685853 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1343/2661] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:28 2022] PUT /identity/v3/projects/22de2d9f56684460a9c3391c45d9aa1e/users/f2d6353e2d804e23b70e032a6632fed9/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:28.687810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:28.753160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c53887-7641-4b9c-b050-0ae32c02f689 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:28.753443 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c53887-7641-4b9c-b050-0ae32c02f689 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:28.753718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c53887-7641-4b9c-b050-0ae32c02f689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:28.784926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-30c53887-7641-4b9c-b050-0ae32c02f689 None None] MFA Rules not processed for user `f2d6353e2d804e23b70e032a6632fed9`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:28.786460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-30c53887-7641-4b9c-b050-0ae32c02f689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:28.855871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1319/2662] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:28.869672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:28.869981 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:28.950504 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426e935-11f2-450c-b5cd-f50899c73963 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:28.954303 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:28.954908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:28.955191 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:28.955461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:29.002924 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:29.016786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:29.019214 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:29.027744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1344/2663] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:29.122789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:31.488378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c53887-7641-4b9c-b050-0ae32c02f689 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:31.498634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c53887-7641-4b9c-b050-0ae32c02f689 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:31.502956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8646422-c816-490f-9f8e-c6c8d2002555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:31.503635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8646422-c816-490f-9f8e-c6c8d2002555 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:31.506099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8646422-c816-490f-9f8e-c6c8d2002555 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:31.506099 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8646422-c816-490f-9f8e-c6c8d2002555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:31.532394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:31.564517 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8646422-c816-490f-9f8e-c6c8d2002555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:31.566009 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8646422-c816-490f-9f8e-c6c8d2002555 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:31.576273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1320/2664] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:32.035419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:32.036875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:32.097937 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:32.111491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3483b0-db99-47ce-a967-f2dfe525f8c0 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:32.116112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:32.116752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:32.117056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:32.117329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] PATH_INFO: `/v3/users/66ec8df33260416ab1828cf413ddf813` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:32.118473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ec8df33260416ab1828cf413ddf813)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:32.120558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:32.526116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ec8df33260416ab1828cf413ddf813'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:32.526910 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ec8df33260416ab1828cf413ddf813'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:32.618747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ec8df33260416ab1828cf413ddf813'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:32.619376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ec8df33260416ab1828cf413ddf813'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:32.628340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ec8df33260416ab1828cf413ddf813'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:32.646948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1345/2665] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:32 2022] DELETE /identity/v3/users/66ec8df33260416ab1828cf413ddf813 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:32.652659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:32.652659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:32.653265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:32.672892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:32.674143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:32.738054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1321/2666] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:32.747667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:32.749421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:32.817435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c17ca-1968-4c36-84b2-36c06b2e9a40 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:32.820966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:32.821570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:32.821849 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:32.822173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:32.831528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:32.833102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:32.843308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1346/2667] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:33.400626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:33.402279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:33.423307 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d81d-31d7-460f-b8ca-d996b47ccc04 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:33.431232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:33.432351 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:33.432970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:33.433113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] PATH_INFO: `/v3/projects/4b50dba5a5b84026885e5943393e877f` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:33.435953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b50dba5a5b84026885e5943393e877f)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:33.437581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:33.652061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:33.654123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:33.677994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b50dba5a5b84026885e5943393e877f', 'request_id': 'req-551668fd-bbb4-4dd7-8468-8dc8df5d0720'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:33.686028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b50dba5a5b84026885e5943393e877f', 'request_id': 'req-551668fd-bbb4-4dd7-8468-8dc8df5d0720'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:33.721232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311ec7-6dc2-4e89-ae44-a739cdd6e8d1 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:33.751859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:33.773383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:33.774078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:33.774357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:33.774654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:33.776640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:33.841571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:33.843848 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:33.864837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1347/2668] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:33.893965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b50dba5a5b84026885e5943393e877f', 'request_id': 'req-551668fd-bbb4-4dd7-8468-8dc8df5d0720'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:33.907216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] The token cache is being invalidate because project 4b50dba5a5b84026885e5943393e877f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:33.907647 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:33.910197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:33.910197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1322/2669] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:33 2022] DELETE /identity/v3/projects/4b50dba5a5b84026885e5943393e877f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:33.914796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:33.981172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1863e9-063c-4c0b-9095-0b16c461df66 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:33.991439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:33.992112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:33.992381 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:33.992654 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] PATH_INFO: `/v3/users/42f161e1b32040b68a7d545a20c47d8b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:33.993903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f161e1b32040b68a7d545a20c47d8b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:33.995927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:34.306828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f161e1b32040b68a7d545a20c47d8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:34.307487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f161e1b32040b68a7d545a20c47d8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:34.447353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f161e1b32040b68a7d545a20c47d8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:34.447956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f161e1b32040b68a7d545a20c47d8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:34.457667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-98eb893c-39aa-4710-8cf4-3168ce2ee1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f161e1b32040b68a7d545a20c47d8b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:34.471982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:34.476340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1348/2670] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:33 2022] DELETE /identity/v3/users/42f161e1b32040b68a7d545a20c47d8b => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:35.050837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:35.053505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:35.069665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551668fd-bbb4-4dd7-8468-8dc8df5d0720 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:35.122242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:35.134105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:35.134740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:35.135016 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:35.135288 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] PATH_INFO: `/v3/projects/c0093653542e4fab971f8cb6b27b1d32` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:35.136416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0093653542e4fab971f8cb6b27b1d32)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:35.139060 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:35.316956 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0093653542e4fab971f8cb6b27b1d32', 'request_id': 'req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:35.323238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0093653542e4fab971f8cb6b27b1d32', 'request_id': 'req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:35.482492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0093653542e4fab971f8cb6b27b1d32', 'request_id': 'req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:35.499239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] The token cache is being invalidate because project c0093653542e4fab971f8cb6b27b1d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:35.499239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:35.499239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6aaab8ff-45e0-47fc-a2b0-02fe78f39d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:35.499239 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1323/2671] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:35 2022] DELETE /identity/v3/projects/c0093653542e4fab971f8cb6b27b1d32 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:35.502177 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19fa27-4e70-404c-a700-d5645fe7ceaf None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:35.502676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19fa27-4e70-404c-a700-d5645fe7ceaf None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:35.502789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19fa27-4e70-404c-a700-d5645fe7ceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:35.523167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-af19fa27-4e70-404c-a700-d5645fe7ceaf None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:35.524392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-af19fa27-4e70-404c-a700-d5645fe7ceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:35.597800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1349/2672] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:35.610992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9403-38a1-40db-adf3-5328837ee417 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:35.611428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9403-38a1-40db-adf3-5328837ee417 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:35.611710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9403-38a1-40db-adf3-5328837ee417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:35.638256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-2a6d9403-38a1-40db-adf3-5328837ee417 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:35.639711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-2a6d9403-38a1-40db-adf3-5328837ee417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:35.649899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1324/2673] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:35.654783 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19fa27-4e70-404c-a700-d5645fe7ceaf None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:35.665333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19fa27-4e70-404c-a700-d5645fe7ceaf None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:35.670912 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:35.674304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:35.674304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:35.674304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:35.674304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:35.674304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:35.674980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:35.688794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1350/2674] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:36:35.694468 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d9403-38a1-40db-adf3-5328837ee417 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:35.708164 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d9403-38a1-40db-adf3-5328837ee417 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:35.715671 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:35.716499 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:35.716845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:35.720083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:35.720083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:35.720466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:35.872656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1325/2675] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:35 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:35.877857 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:35.891091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ea23-f1c5-417a-96c6-a75e1490bd81 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:35.976875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:35.977512 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:35.977802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:35.978086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:35.978816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:35.981152 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:36.198015 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1351/2676] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:35 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:36.203219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:36.214325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595291a-224e-4e15-97f3-2dfd98a72efc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:36.220206 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:36.220932 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:36.221210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:36.221481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:36.222133 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:36.223799 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:36.235398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1326/2677] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:36.239612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:36.253193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa7aa-ef3a-4894-be18-416bac5f15b1 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:36.261184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84a61-467f-4929-9335-ecc2ce9cf951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:36.261184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a61-467f-4929-9335-ecc2ce9cf951 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:36.261184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a61-467f-4929-9335-ecc2ce9cf951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:36.261184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84a61-467f-4929-9335-ecc2ce9cf951 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:36.262421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84a61-467f-4929-9335-ecc2ce9cf951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:36.262421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84a61-467f-4929-9335-ecc2ce9cf951 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:36.280620 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1352/2678] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:36.284407 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:36.301827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aee23-0518-489a-a813-a99259ff6051 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:36.305122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:36.306210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:36.306675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:36.307165 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] PATH_INFO: `/v3/projects/a144cb2c2af945e0bf6bcb12e20dc37b/users/76bc8738643d44289c195ce7a40cf6ba/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:36.329726 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a144cb2c2af945e0bf6bcb12e20dc37b, user_id=76bc8738643d44289c195ce7a40cf6ba, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:36.333836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:36.494122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1327/2679] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:36 2022] PUT /identity/v3/projects/a144cb2c2af945e0bf6bcb12e20dc37b/users/76bc8738643d44289c195ce7a40cf6ba/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:36.506022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:36.506559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:36.506559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:36.535679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] MFA Rules not processed for user `76bc8738643d44289c195ce7a40cf6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:36.536818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:36.595793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:36.604776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1353/2680] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:36.616515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:36.618220 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:36.677421 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784593c-cfb5-4b7f-9417-48858a86ad7a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:36.681411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aec971-4fdb-4ae0-a7a4-b34f04537dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:36.682013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec971-4fdb-4ae0-a7a4-b34f04537dfe service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:36.682286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec971-4fdb-4ae0-a7a4-b34f04537dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:36.682558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec971-4fdb-4ae0-a7a4-b34f04537dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:36.691249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aec971-4fdb-4ae0-a7a4-b34f04537dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:36.692952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aec971-4fdb-4ae0-a7a4-b34f04537dfe service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:36.703381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1328/2681] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:40.459891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:40.461907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:40.535592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c59eb-32cb-439c-a21b-3adf3bc9a2ca None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:40.540865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:40.541506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:40.541822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:40.542089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] PATH_INFO: `/v3/users/ac5323b2db6f4a7c9a3963d042275010` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:40.544048 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5323b2db6f4a7c9a3963d042275010)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:40.546301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:40.868498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5323b2db6f4a7c9a3963d042275010'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:40.869232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5323b2db6f4a7c9a3963d042275010'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:40.961744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5323b2db6f4a7c9a3963d042275010'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:40.962368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5323b2db6f4a7c9a3963d042275010'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:40.970668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5323b2db6f4a7c9a3963d042275010'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:40.989212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1354/2682] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:40 2022] DELETE /identity/v3/users/ac5323b2db6f4a7c9a3963d042275010 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:40.993763 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:40.994223 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:40.994320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:41.013696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:41.014904 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:41.027249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:41.083605 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1329/2683] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:41.094488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:41.095920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:41.158754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8865a-ad86-411b-8c5b-2100a0db5dc4 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:41.162934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:41.163536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:41.163817 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:41.164085 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:41.174225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:41.175673 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:41.185589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1355/2684] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:41.471686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:41.473246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:41.485948 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b017-89c4-4160-b307-5e082f839890 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:41.490639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:41.491279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:41.491588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:41.491867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] PATH_INFO: `/v3/users/76bc8738643d44289c195ce7a40cf6ba` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:41.493031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bc8738643d44289c195ce7a40cf6ba)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:41.494952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:41.725105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:41.726602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:41.741109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27ae8e-8939-4d18-b113-9167ea628aec service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:41.747520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:41.748804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:41.748804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:41.749055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] PATH_INFO: `/v3/projects/029ec67b979047b7bab7b9b3eff38fae` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:41.750203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] RBAC: Authorizing `identity:delete_project(project_id=029ec67b979047b7bab7b9b3eff38fae)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:41.752340 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:41.765327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:41.839234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bc8738643d44289c195ce7a40cf6ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.872690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029ec67b979047b7bab7b9b3eff38fae', 'request_id': 'req-67f96b2c-9c47-4431-82ce-45c5aee6598c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.878934 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029ec67b979047b7bab7b9b3eff38fae', 'request_id': 'req-67f96b2c-9c47-4431-82ce-45c5aee6598c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.885449 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029ec67b979047b7bab7b9b3eff38fae', 'request_id': 'req-67f96b2c-9c47-4431-82ce-45c5aee6598c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.905053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bc8738643d44289c195ce7a40cf6ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.905699 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bc8738643d44289c195ce7a40cf6ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.918952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bc8738643d44289c195ce7a40cf6ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.926895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-4c18d687-14ea-48bf-a9c8-b38d4d7068d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bc8738643d44289c195ce7a40cf6ba'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.932989 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1330/2685] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:41 2022] DELETE /identity/v3/users/76bc8738643d44289c195ce7a40cf6ba => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:41.939003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:41.939308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:41.939583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:41.959755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:41.963629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:41.990326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] The token cache is being invalidate because project 029ec67b979047b7bab7b9b3eff38fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:41.990610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.991234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:41.993038 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1356/2686] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:41 2022] DELETE /identity/v3/projects/029ec67b979047b7bab7b9b3eff38fae => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:41.997581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:41.999104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:42.029242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1331/2687] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:42.040461 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:42.041958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:42.070776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96b2c-9c47-4431-82ce-45c5aee6598c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:42.075867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:42.078144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:42.078144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:42.078144 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] PATH_INFO: `/v3/users/2333dfb23201425dbdda58d2f49213ad` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:42.079157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2333dfb23201425dbdda58d2f49213ad)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:42.081163 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:42.081292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:42.109706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bcca2-9e79-40fe-8fcb-1beaed2f78c3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:42.113285 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:42.113893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:42.114265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:42.114440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:42.124686 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:42.126240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:42.136301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1332/2688] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:42.358828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2333dfb23201425dbdda58d2f49213ad'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.360113 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2333dfb23201425dbdda58d2f49213ad'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.487702 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2333dfb23201425dbdda58d2f49213ad'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.488358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2333dfb23201425dbdda58d2f49213ad'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.498775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65f84350-4142-4ab4-aada-38e03e4a9eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2333dfb23201425dbdda58d2f49213ad'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.523169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1357/2689] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:41 2022] DELETE /identity/v3/users/2333dfb23201425dbdda58d2f49213ad => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:42.629712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:42.630596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:42.643685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6dc3f-ce81-410e-bb46-77bae31451c0 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:42.710041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:42.710683 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:42.710965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:42.720837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] PATH_INFO: `/v3/projects/a144cb2c2af945e0bf6bcb12e20dc37b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:42.720837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a144cb2c2af945e0bf6bcb12e20dc37b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:42.720837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:42.890142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a144cb2c2af945e0bf6bcb12e20dc37b', 'request_id': 'req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.897766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a144cb2c2af945e0bf6bcb12e20dc37b', 'request_id': 'req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.973298 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a144cb2c2af945e0bf6bcb12e20dc37b', 'request_id': 'req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.984785 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] The token cache is being invalidate because project a144cb2c2af945e0bf6bcb12e20dc37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:42.985175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.985827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-8f6c2732-1317-4ab8-8d73-774ec1ae7edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:42.987319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1333/2690] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:42 2022] DELETE /identity/v3/projects/a144cb2c2af945e0bf6bcb12e20dc37b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:42.992385 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:42.992903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:42.993022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.014037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:43.016210 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:43.029809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:43.089090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1358/2691] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:43.098451 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d84b9-bbda-4ee0-8012-b4f741c59315 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.098988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d84b9-bbda-4ee0-8012-b4f741c59315 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.098988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d84b9-bbda-4ee0-8012-b4f741c59315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.119418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.124197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-5a2d84b9-bbda-4ee0-8012-b4f741c59315 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:43.125481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5a2d84b9-bbda-4ee0-8012-b4f741c59315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:43.129521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:43.141238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1334/2692] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:43.144839 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034c175-0c71-4f54-a8ea-acceadc815f7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.145659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d84b9-bbda-4ee0-8012-b4f741c59315 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.154119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.154776 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.155090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.155371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] PATH_INFO: `/v3/projects/029114f4ea994a07806117d1141689e3` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.156608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029114f4ea994a07806117d1141689e3)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.158865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.159183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d84b9-bbda-4ee0-8012-b4f741c59315 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.164273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.164916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.165249 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.165462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.166143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:43.166422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.168617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.182062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1335/2693] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:36:43.188429 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.198287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ec6b5-5b56-4157-b158-8198bd297b15 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.203586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.204180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.204462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.204758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.205504 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.207410 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.323912 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1336/2694] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:43.328984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.336911 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029114f4ea994a07806117d1141689e3', 'request_id': 'req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.343204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029114f4ea994a07806117d1141689e3', 'request_id': 'req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.349992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029114f4ea994a07806117d1141689e3', 'request_id': 'req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.355554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:43.394436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab04-6817-4745-be1e-8970d49b8950 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.399293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.399969 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.400509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.400807 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.401440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.403550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.453675 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] The token cache is being invalidate because project 029114f4ea994a07806117d1141689e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:43.454137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.455010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.456724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1359/2695] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:43 2022] DELETE /identity/v3/projects/029114f4ea994a07806117d1141689e3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:43.461114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.462669 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:43.508501 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1337/2696] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:43 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:43.511032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.512514 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:43.528609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c4cb-44c9-48d6-a247-56b198577aa8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.538487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.538487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.538487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.538487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.538809 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.539308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.541832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a3d05-d7d8-4227-84c0-ee82ea1ca7a1 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.547475 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.548265 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.548547 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.548846 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] PATH_INFO: `/v3/users/f2d6353e2d804e23b70e032a6632fed9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.549985 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d6353e2d804e23b70e032a6632fed9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.551950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.567291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1338/2697] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:43.570096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.585841 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e506-3db3-4c00-895a-044f8bfc3006 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.592422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.594254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.594254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.594254 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.594549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.596058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.607666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1339/2698] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:43.612525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.622831 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706207d8-b937-424c-9508-3405e760cbe3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.627549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da6cd0-17f9-408e-8e3b-7466986c04fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.628197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da6cd0-17f9-408e-8e3b-7466986c04fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.628478 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da6cd0-17f9-408e-8e3b-7466986c04fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.628827 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da6cd0-17f9-408e-8e3b-7466986c04fc admin admin] PATH_INFO: `/v3/projects/d44d4817707043ccbc81b47686468ada/users/5f267f9faa1e4c0592b8aa6aa94c49ba/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.644408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da6cd0-17f9-408e-8e3b-7466986c04fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44d4817707043ccbc81b47686468ada, user_id=5f267f9faa1e4c0592b8aa6aa94c49ba, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.647194 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da6cd0-17f9-408e-8e3b-7466986c04fc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:43.730901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1340/2699] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:43 2022] PUT /identity/v3/projects/d44d4817707043ccbc81b47686468ada/users/5f267f9faa1e4c0592b8aa6aa94c49ba/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:43.743010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.743469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.743765 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.772513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] MFA Rules not processed for user `5f267f9faa1e4c0592b8aa6aa94c49ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:43.773821 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:43.797309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:43.799155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d6353e2d804e23b70e032a6632fed9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.799922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d6353e2d804e23b70e032a6632fed9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.841735 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1341/2700] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:43.846186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:43.847612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:43.881676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d6353e2d804e23b70e032a6632fed9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.882437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d6353e2d804e23b70e032a6632fed9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.891362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d6353e2d804e23b70e032a6632fed9'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:43.910744 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1360/2701] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:43 2022] DELETE /identity/v3/users/f2d6353e2d804e23b70e032a6632fed9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:43.914697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcc308-c87c-4dd2-ba6a-9b712c36e5d2 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:43.974983 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:43.975601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:43.975898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:43.976196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:43.976869 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:43.978779 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.002449 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:44.089469 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1342/2702] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:43 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:44.093996 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.104089 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6e686-7e69-4967-a8a0-cf18afa62e75 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.168187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.169209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.169489 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.169760 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.170518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.172445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.272482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1361/2703] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:44 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:44.276986 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.288656 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3e381-67b5-49a2-a88f-f7e94e10663f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.293727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.295026 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.295492 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.295834 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.296513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.298326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.309584 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1343/2704] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:44.315162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.325570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba565-1314-4e43-b402-5d5d7f46d354 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.330467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.332325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.332325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.332325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.332325 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.333896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.344565 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1362/2705] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:44.348923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.359705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5524-acaf-4c96-8aba-e67ec18c64e4 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.364335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b28ac-4344-4daa-aaa3-5c308bc65f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.365018 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b28ac-4344-4daa-aaa3-5c308bc65f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.365304 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b28ac-4344-4daa-aaa3-5c308bc65f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.365612 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b28ac-4344-4daa-aaa3-5c308bc65f70 admin admin] PATH_INFO: `/v3/projects/2ff1d788601e4330b96e8424cd903949/users/b962528f843048b8ad78218ca3b1e1c1/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.381150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b28ac-4344-4daa-aaa3-5c308bc65f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff1d788601e4330b96e8424cd903949, user_id=b962528f843048b8ad78218ca3b1e1c1, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.383833 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b28ac-4344-4daa-aaa3-5c308bc65f70 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.415058 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.416979 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:44.433060 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa983d-d193-4a68-8eab-e11b0a340640 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.439510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.440463 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.440685 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.441003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] PATH_INFO: `/v3/projects/22de2d9f56684460a9c3391c45d9aa1e` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.442224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22de2d9f56684460a9c3391c45d9aa1e)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.444123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.471124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1344/2706] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:44 2022] PUT /identity/v3/projects/2ff1d788601e4330b96e8424cd903949/users/b962528f843048b8ad78218ca3b1e1c1/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:44.482197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c87401-7bbc-44e8-b818-fe199b830ca7 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.482619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c87401-7bbc-44e8-b818-fe199b830ca7 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.483092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c87401-7bbc-44e8-b818-fe199b830ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.520951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b9c87401-7bbc-44e8-b818-fe199b830ca7 None None] MFA Rules not processed for user `b962528f843048b8ad78218ca3b1e1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:44.523169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b9c87401-7bbc-44e8-b818-fe199b830ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:44.574879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22de2d9f56684460a9c3391c45d9aa1e', 'request_id': 'req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:44.583877 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22de2d9f56684460a9c3391c45d9aa1e', 'request_id': 'req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:44.591769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22de2d9f56684460a9c3391c45d9aa1e', 'request_id': 'req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:44.640554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1345/2707] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:44.644923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c87401-7bbc-44e8-b818-fe199b830ca7 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.665984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] The token cache is being invalidate because project 22de2d9f56684460a9c3391c45d9aa1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:44.666540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:44.667717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7ed21d29-ca28-4bcf-ba72-9ede3fe1a7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:44.674479 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1363/2708] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:44 2022] DELETE /identity/v3/projects/22de2d9f56684460a9c3391c45d9aa1e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:44.676515 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016064-d8b6-49ef-bf0e-b5fa619779b9 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.677128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016064-d8b6-49ef-bf0e-b5fa619779b9 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.677417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7016064-d8b6-49ef-bf0e-b5fa619779b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.694365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:44.704158 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-d7016064-d8b6-49ef-bf0e-b5fa619779b9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:44.705234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d7016064-d8b6-49ef-bf0e-b5fa619779b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:44.715300 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c87401-7bbc-44e8-b818-fe199b830ca7 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.731082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:44.781056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1364/2709] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:44.788995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.789143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae37406-28da-4d78-997e-e9c84a0054c0 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.789417 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae37406-28da-4d78-997e-e9c84a0054c0 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.789663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.789763 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae37406-28da-4d78-997e-e9c84a0054c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.790132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.790326 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.790839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.792770 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.825101 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-1ae37406-28da-4d78-997e-e9c84a0054c0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:44.826612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-1ae37406-28da-4d78-997e-e9c84a0054c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:44.836758 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1365/2710] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:44.842031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae37406-28da-4d78-997e-e9c84a0054c0 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.853937 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae37406-28da-4d78-997e-e9c84a0054c0 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.863982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.865197 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.865661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.866099 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.867292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:44.867794 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.870823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.890628 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1366/2711] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:36:44.895454 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.906988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d90b7-e2b0-4efa-bc90-ec21dc3a9a33 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:44.911997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:44.912630 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:44.912960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:44.913226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:44.913861 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:44.915775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:44.951398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1346/2712] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:44 2022] POST /identity/v3/projects => generated 383 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:44.952689 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:44.954202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:45.010856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1367/2713] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:44 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:45.016093 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.031591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa8ab4-1c97-4403-858e-728bd5a2c26d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.084062 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c6db-1083-456c-9119-8a953c389e1d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.088971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.089577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.089945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.090132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.090788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.093621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.100669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.101473 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.101925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.102091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.102868 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.104842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.230650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1347/2714] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:44 2022] POST /identity/v3/users => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:45.233791 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1368/2715] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:45 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:45.235340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.235589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.245698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87b576-1723-4a69-88aa-6a83b43fd2c5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.246738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7ca9a-a250-428f-918a-f9084547d8e2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.250553 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.251301 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.251593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.251715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.251862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.252193 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.252474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.252570 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.252783 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.253470 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.254312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.255048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.265906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1369/2716] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:45.269167 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1348/2717] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:45.270149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.273171 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.281571 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:45.284535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989e2f-4d19-462d-a0e7-8c83879d83f5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.287050 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0690d-e58f-456d-801b-cc91090ad725 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.287220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.287831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.288118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.288399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.289080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.290742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.292548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.293299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.293652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.294013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] PATH_INFO: `/v3/projects/015ae8819a544786a3b4d678245eddbb/users/99f4fd1ab68647a1867ab2ea7080278b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.302155 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1370/2718] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:45.313519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.313681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015ae8819a544786a3b4d678245eddbb, user_id=99f4fd1ab68647a1867ab2ea7080278b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.315914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.316715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20ff5-9bb0-4a0e-b1df-f735177fc0ca admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.321816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beec3c-7d1a-420f-928c-66496ae60cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.322474 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beec3c-7d1a-420f-928c-66496ae60cde admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.322761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beec3c-7d1a-420f-928c-66496ae60cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.323064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beec3c-7d1a-420f-928c-66496ae60cde admin admin] PATH_INFO: `/v3/projects/b19e826d1ace424c90e6a716a6d0ac90/users/bac353c41ef341d5a2eba557ff9846ed/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.339217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2beec3c-7d1a-420f-928c-66496ae60cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19e826d1ace424c90e6a716a6d0ac90, user_id=bac353c41ef341d5a2eba557ff9846ed, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.342010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2beec3c-7d1a-420f-928c-66496ae60cde admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.397797 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1349/2719] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:45 2022] PUT /identity/v3/projects/015ae8819a544786a3b4d678245eddbb/users/99f4fd1ab68647a1867ab2ea7080278b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:45.402207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.422209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1371/2720] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:45 2022] PUT /identity/v3/projects/b19e826d1ace424c90e6a716a6d0ac90/users/bac353c41ef341d5a2eba557ff9846ed/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:45.429088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.429374 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.429649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.450418 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:45.451550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:45.475124 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb258b59-28c8-4175-ba88-934555081d14 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.540939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.541572 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.541852 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.542126 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.542820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.544661 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.556093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1350/2721] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:36:45.560536 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.572409 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bebd54-3d0e-493a-8d82-1d716a68cdb3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.578508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7705cdb-bf0e-47bd-887a-783b2e2be60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.583097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7705cdb-bf0e-47bd-887a-783b2e2be60f admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.583097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7705cdb-bf0e-47bd-887a-783b2e2be60f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.583097 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7705cdb-bf0e-47bd-887a-783b2e2be60f admin admin] PATH_INFO: `/v3/projects/015ae8819a544786a3b4d678245eddbb/users/99f4fd1ab68647a1867ab2ea7080278b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.583433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7705cdb-bf0e-47bd-887a-783b2e2be60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=015ae8819a544786a3b4d678245eddbb, user_id=99f4fd1ab68647a1867ab2ea7080278b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.585874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7705cdb-bf0e-47bd-887a-783b2e2be60f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.597558 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1351/2722] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:45 2022] PUT /identity/v3/projects/015ae8819a544786a3b4d678245eddbb/users/99f4fd1ab68647a1867ab2ea7080278b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:45.608031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.608342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.609522 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.618882 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:45.641154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] MFA Rules not processed for user `99f4fd1ab68647a1867ab2ea7080278b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:45.642110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1372/2723] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:45.642250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:45.652012 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.653569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:45.700385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:45.712800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c806-4ec3-421a-b8ff-80470ece205f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.724662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1352/2724] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:36:45.732392 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:45.734562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:45.774358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eab14a-f1a8-4c2c-89bb-2a292fabb197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.774982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eab14a-f1a8-4c2c-89bb-2a292fabb197 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.775518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eab14a-f1a8-4c2c-89bb-2a292fabb197 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.775802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eab14a-f1a8-4c2c-89bb-2a292fabb197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.798031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90963-49ec-4321-84b5-9613a522416e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:45.802819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:45.803826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:45.804142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:45.804418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:45.806750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:45.839617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eab14a-f1a8-4c2c-89bb-2a292fabb197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.841217 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eab14a-f1a8-4c2c-89bb-2a292fabb197 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.851388 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1373/2725] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:45.871738 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:45.873256 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:45.884525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1353/2726] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:47.318403 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569acfe9-2791-4772-8713-1fac15554583 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:47.319204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569acfe9-2791-4772-8713-1fac15554583 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:47.319204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569acfe9-2791-4772-8713-1fac15554583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:47.352736 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-569acfe9-2791-4772-8713-1fac15554583 None None] MFA Rules not processed for user `bac353c41ef341d5a2eba557ff9846ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:47.354119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-569acfe9-2791-4772-8713-1fac15554583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:47.377136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:47.427897 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1374/2727] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:47.442260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:47.443716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:47.456548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf456f-8dd9-440f-bc07-07f36c4adb91 service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:47.462487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436cb89-8c33-4e0d-93f5-0b7609dcaf4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:47.462487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cb89-8c33-4e0d-93f5-0b7609dcaf4a service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:47.462487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cb89-8c33-4e0d-93f5-0b7609dcaf4a service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:47.462487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cb89-8c33-4e0d-93f5-0b7609dcaf4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:47.472190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436cb89-8c33-4e0d-93f5-0b7609dcaf4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:47.473679 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436cb89-8c33-4e0d-93f5-0b7609dcaf4a service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:47.489202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1354/2728] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:48.011196 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569acfe9-2791-4772-8713-1fac15554583 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:48.021634 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569acfe9-2791-4772-8713-1fac15554583 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:48.025175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:48.026037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:48.026315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:48.026582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:48.028298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:48.089270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:48.090612 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:48.100149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1375/2729] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:49.479382 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:49.486295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:49.486295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:49.501096 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] MFA Rules not processed for user `bac353c41ef341d5a2eba557ff9846ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:49.502337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:49.509377 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1355/2730] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:49.552980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:49.554473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:49.615851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed9c8-3d71-41c2-98d6-9fc10ed26e99 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:49.619631 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f0ee202c7946db8c77e1048d092fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:49.620253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:49.620554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:49.620856 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:49.622580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:49.658692 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:49.660302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:49.678532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438797-ebb8-43d0-9e19-807da2f68250 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:49.684514 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:49.685455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:49.685576 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:49.685798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] PATH_INFO: `/v3/users/aa72653d77e746d7bf3970a85de93ee8` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:49.687876 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa72653d77e746d7bf3970a85de93ee8)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:49.690047 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:49.703473 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:49.705193 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:49.716545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1376/2731] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:49.893275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa72653d77e746d7bf3970a85de93ee8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:49.931499 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:49.936130 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:49.943963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1f3e-dc74-4cde-aaf9-ad6b44fdf6a9 service glance] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:49.946140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae1965-559a-4be2-9da9-99b2087ed5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:49.946757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1965-559a-4be2-9da9-99b2087ed5bd service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:49.947031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1965-559a-4be2-9da9-99b2087ed5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:49.947296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1965-559a-4be2-9da9-99b2087ed5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:49.949079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2eae1965-559a-4be2-9da9-99b2087ed5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:49.959991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae1965-559a-4be2-9da9-99b2087ed5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:49.961658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae1965-559a-4be2-9da9-99b2087ed5bd service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:49.971337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1377/2732] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:50.000847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa72653d77e746d7bf3970a85de93ee8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:50.001653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa72653d77e746d7bf3970a85de93ee8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:50.017074 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa72653d77e746d7bf3970a85de93ee8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:50.024535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa72653d77e746d7bf3970a85de93ee8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:50.026416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:50.039141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1356/2733] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:49 2022] DELETE /identity/v3/users/aa72653d77e746d7bf3970a85de93ee8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:50.042644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:50.043186 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:50.043687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:50.066459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:50.067472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.092825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:50.094613 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.142562 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1378/2734] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:50.153167 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:50.154713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.161388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3604dd1-088b-4b29-8ca4-a10c8b582c13 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:50.165128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:50.165793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:50.168303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:50.168303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:50.168303 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.219440 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735c06-3654-4768-800c-1d761b7b50b7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:50.223642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:50.224248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:50.224524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:50.224858 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:50.237090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:50.238686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:50.243286 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:50.244777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:50.248899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1379/2735] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:50.255906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1357/2736] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:50.447323 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:50.449220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.466565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:50.468015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.490383 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de802aed-0648-4c47-9ebb-f07039719bae service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:50.496992 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:50.498003 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:50.498566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:50.498911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:50.501985 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.550720 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c541801-f32c-4130-9676-5b08b1f2d196 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:50.557059 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:50.557699 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:50.557950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:50.558239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:50.560225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.575333 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:50.577084 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:50.588535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1380/2737] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:50.591903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:50.594110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:50.614049 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1358/2738] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:50.720810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:50.725164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:50.745097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0802-6e88-4bd9-a44e-369cf8401709 service placement] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:50.750468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:50.751094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:50.751371 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:50.751639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] PATH_INFO: `/v3/projects/fa855ea427384f22814513dc9f3bb5c2` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:50.752814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa855ea427384f22814513dc9f3bb5c2)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:50.754717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:50.780353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:50.871993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa855ea427384f22814513dc9f3bb5c2', 'request_id': 'req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:50.877875 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa855ea427384f22814513dc9f3bb5c2', 'request_id': 'req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:50.884271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa855ea427384f22814513dc9f3bb5c2', 'request_id': 'req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.007983 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] The token cache is being invalidate because project fa855ea427384f22814513dc9f3bb5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:51.008335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.009102 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.010752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1381/2739] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:50 2022] DELETE /identity/v3/projects/fa855ea427384f22814513dc9f3bb5c2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:51.015858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:51.027010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32da6b-3e4a-4644-9c03-67a917f67293 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:51.086368 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:51.086995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:51.087272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:51.087542 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] PATH_INFO: `/v3/users/0fb149bdb66c47559dfc15f98d91b883` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:51.088646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb149bdb66c47559dfc15f98d91b883)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:51.090576 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:51.106116 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:51.306905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb149bdb66c47559dfc15f98d91b883'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.361592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb149bdb66c47559dfc15f98d91b883'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.362248 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb149bdb66c47559dfc15f98d91b883'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.375275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb149bdb66c47559dfc15f98d91b883'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.384207 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-fc28a101-8bc0-4cbe-828e-c21697c80a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb149bdb66c47559dfc15f98d91b883'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:51.394892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1359/2740] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:51 2022] DELETE /identity/v3/users/0fb149bdb66c47559dfc15f98d91b883 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:51.913251 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:51.914755 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:51.930993 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d368d8-b5ea-47c9-9ce8-619fbe0ca13c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:51.993906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:51.994603 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:51.995037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:51.995367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] PATH_INFO: `/v3/projects/bd126824ced347d291e7ea3ceb28d085` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:51.996493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd126824ced347d291e7ea3ceb28d085)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:51.998517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:52.260527 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd126824ced347d291e7ea3ceb28d085', 'request_id': 'req-e8fca227-5157-40d1-9b22-e206ed90b2af'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:52.267107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd126824ced347d291e7ea3ceb28d085', 'request_id': 'req-e8fca227-5157-40d1-9b22-e206ed90b2af'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:52.273438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd126824ced347d291e7ea3ceb28d085', 'request_id': 'req-e8fca227-5157-40d1-9b22-e206ed90b2af'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:52.429647 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] The token cache is being invalidate because project bd126824ced347d291e7ea3ceb28d085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:52.429888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:52.430487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e8fca227-5157-40d1-9b22-e206ed90b2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:52.431967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1382/2741] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:51 2022] DELETE /identity/v3/projects/bd126824ced347d291e7ea3ceb28d085 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:52.437466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5192-aaf4-4281-bdda-ce59c35ee9db None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:52.438205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5192-aaf4-4281-bdda-ce59c35ee9db None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:52.438398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5192-aaf4-4281-bdda-ce59c35ee9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:52.461719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-06fb5192-aaf4-4281-bdda-ce59c35ee9db None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:52.462979 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-06fb5192-aaf4-4281-bdda-ce59c35ee9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:52.530106 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1360/2742] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:52.539581 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c94a4e-e5c3-4bcb-9638-33dc5a53ab3f None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:52.544809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c94a4e-e5c3-4bcb-9638-33dc5a53ab3f None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:52.544809 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c94a4e-e5c3-4bcb-9638-33dc5a53ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:52.561652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b8c94a4e-e5c3-4bcb-9638-33dc5a53ab3f None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:52.563987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b8c94a4e-e5c3-4bcb-9638-33dc5a53ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:52.572536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1383/2743] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:52.577444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5192-aaf4-4281-bdda-ce59c35ee9db None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:52.587550 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5192-aaf4-4281-bdda-ce59c35ee9db None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:52.592219 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:52.592855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:52.593251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:52.593609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:52.594308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:36:52.594618 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:52.596225 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:52.609192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1361/2744] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:36:52.613806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c94a4e-e5c3-4bcb-9638-33dc5a53ab3f None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:52.623538 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c94a4e-e5c3-4bcb-9638-33dc5a53ab3f None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:52.630213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:52.630822 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:52.634718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:52.634718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:52.634718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:52.634718 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:52.792898 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1384/2745] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:52 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:52.796032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:52.807310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050d9d2-5309-475b-a0a9-60148329628e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:52.850114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:52.877238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:52.877867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:52.878217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:52.878412 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:52.879292 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:52.881302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.037014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1362/2746] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:52 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:36:53.041470 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.053754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1779e-3eb8-43fa-8bea-9520ead46eec admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:53.058490 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:53.059091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.059372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.059644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.060284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:53.061903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.063423 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:53.072845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1385/2747] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:53.077032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.087398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abadb3a-0e9f-4b40-ab2a-6c229a4264b8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:53.098627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61b9b5-2d7d-4635-abdd-15d05da48527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:53.098627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61b9b5-2d7d-4635-abdd-15d05da48527 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.098627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61b9b5-2d7d-4635-abdd-15d05da48527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.098627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61b9b5-2d7d-4635-abdd-15d05da48527 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.099071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61b9b5-2d7d-4635-abdd-15d05da48527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:53.099071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61b9b5-2d7d-4635-abdd-15d05da48527 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.107634 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1363/2748] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:53.112771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.123097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c8f15-13ae-42fa-b1b5-74c192d0c0da admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:53.128535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:53.129252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.129532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.129967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] PATH_INFO: `/v3/projects/ca1181b2824244dd873f296b49c60b7a/users/8bdbcbe0f65d4ead84123d029029e203/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.149245 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1181b2824244dd873f296b49c60b7a, user_id=8bdbcbe0f65d4ead84123d029029e203, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:53.152222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.300467 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1386/2749] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:53 2022] PUT /identity/v3/projects/ca1181b2824244dd873f296b49c60b7a/users/8bdbcbe0f65d4ead84123d029029e203/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:53.311250 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c81da-0940-4d8a-b23e-ec8377212075 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.311743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c81da-0940-4d8a-b23e-ec8377212075 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.312110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c81da-0940-4d8a-b23e-ec8377212075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.343176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-887c81da-0940-4d8a-b23e-ec8377212075 None None] MFA Rules not processed for user `8bdbcbe0f65d4ead84123d029029e203`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:53.345458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-887c81da-0940-4d8a-b23e-ec8377212075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:53.419608 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1364/2750] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:53.424906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.496278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8b156-784d-4b17-8360-b442021c23d5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:53.501431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:53.502045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.502322 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.502594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.503232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:53.505173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.605021 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1387/2751] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:36:53 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:53.609526 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c81da-0940-4d8a-b23e-ec8377212075 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.621555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c81da-0940-4d8a-b23e-ec8377212075 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:53.699205 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:53.700367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.700367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.700367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.701066 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:53.703893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.802262 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1365/2752] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:36:53 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:36:53.806287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.820935 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcac972-6c4f-488b-953e-70e1410e49a7 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:53.825649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:53.826250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.826526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.826799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.827464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:53.829924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.841559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1388/2753] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:53.853418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.857603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156519-6a0c-4b26-a9f0-52867a118a2e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:53.864684 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:53.865367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:53.865650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:53.865926 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] PATH_INFO: `/v3/projects/3b7c8d3965d443ddb92503b880bf416b/users/e7155d3ea2c94ae491689fb6fb16e67d/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:53.891488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7c8d3965d443ddb92503b880bf416b, user_id=e7155d3ea2c94ae491689fb6fb16e67d, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:53.897613 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:53.983312 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1366/2754] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:53 2022] PUT /identity/v3/projects/3b7c8d3965d443ddb92503b880bf416b/users/e7155d3ea2c94ae491689fb6fb16e67d/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:36:53.987826 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:53.998871 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a81da8-281c-41d3-a26f-72a08fcda48d admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:54.068480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ac378-3a75-4949-8c5c-1a08f19fe62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:54.069287 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ac378-3a75-4949-8c5c-1a08f19fe62e admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:54.069503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ac378-3a75-4949-8c5c-1a08f19fe62e admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:54.072126 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ac378-3a75-4949-8c5c-1a08f19fe62e admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:54.072968 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ac378-3a75-4949-8c5c-1a08f19fe62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:54.074896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ac378-3a75-4949-8c5c-1a08f19fe62e admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:54.087235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1389/2755] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:36:54.091560 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:54.114210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf182-06cf-48df-835f-b3dff36c7281 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:54.114210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:54.114543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:54.114729 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:54.114874 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] PATH_INFO: `/v3/projects/3b7c8d3965d443ddb92503b880bf416b/users/e7155d3ea2c94ae491689fb6fb16e67d/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:54.117440 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7c8d3965d443ddb92503b880bf416b, user_id=e7155d3ea2c94ae491689fb6fb16e67d, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:54.120087 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:54.128380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:54.134157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1367/2756] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:36:54 2022] PUT /identity/v3/projects/3b7c8d3965d443ddb92503b880bf416b/users/e7155d3ea2c94ae491689fb6fb16e67d/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:54.145569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2ea4-b6fc-46b5-b6ea-81c6ed159ceb None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:54.149312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2ea4-b6fc-46b5-b6ea-81c6ed159ceb None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:54.149312 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2ea4-b6fc-46b5-b6ea-81c6ed159ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:54.179348 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-b5ce2ea4-b6fc-46b5-b6ea-81c6ed159ceb None None] MFA Rules not processed for user `e7155d3ea2c94ae491689fb6fb16e67d`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:54.180662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b5ce2ea4-b6fc-46b5-b6ea-81c6ed159ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:54.214051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:54.262259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1390/2757] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:54.275640 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:54.277551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:54.345970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7ca8-712c-4efd-8f61-bb0de36f9247 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:54.350064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:54.350685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:54.350970 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:54.351245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:54.361691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:54.363299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:54.378143 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1368/2758] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:54.749259 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce2ea4-b6fc-46b5-b6ea-81c6ed159ceb None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:54.760104 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce2ea4-b6fc-46b5-b6ea-81c6ed159ceb None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:54.764112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:54.764877 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:54.765279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:54.766300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:54.846485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:54.853275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:54.860552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1391/2759] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:36:56.244158 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:56.245668 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:56.310545 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2da531-e6d7-4713-9609-9b8582fdbece service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:56.316021 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc23b0-cb6a-4a0f-b9e5-bd5e89cc030e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:56.316680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc23b0-cb6a-4a0f-b9e5-bd5e89cc030e service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:56.317005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc23b0-cb6a-4a0f-b9e5-bd5e89cc030e service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:56.317296 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc23b0-cb6a-4a0f-b9e5-bd5e89cc030e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:56.319092 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-92bc23b0-cb6a-4a0f-b9e5-bd5e89cc030e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:56.331157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc23b0-cb6a-4a0f-b9e5-bd5e89cc030e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:56.341287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc23b0-cb6a-4a0f-b9e5-bd5e89cc030e service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:56.341287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1369/2760] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:56.937893 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:56.942768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:57.011107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ddf6-0a1f-4464-9de5-82e086b84df1 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:57.016974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:57.017800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:57.018088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:57.018370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] PATH_INFO: `/v3/users/5f267f9faa1e4c0592b8aa6aa94c49ba` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:57.019520 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f267f9faa1e4c0592b8aa6aa94c49ba)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:57.021477 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:57.310314 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f267f9faa1e4c0592b8aa6aa94c49ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:57.311077 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f267f9faa1e4c0592b8aa6aa94c49ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:57.389998 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f267f9faa1e4c0592b8aa6aa94c49ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:57.391279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f267f9faa1e4c0592b8aa6aa94c49ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:57.401485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f267f9faa1e4c0592b8aa6aa94c49ba'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:57.406026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:57.419347 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1392/2761] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:56 2022] DELETE /identity/v3/users/5f267f9faa1e4c0592b8aa6aa94c49ba => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:57.429875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:57.429875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:57.429875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:57.448871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:36:57.450272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:57.538121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1370/2762] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:36:57.548786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:57.549585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:57.623082 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5392aa7-524a-4441-836f-0384b5425875 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:57.627852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:57.629982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:57.629982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:57.629982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:57.639625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:57.642004 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:57.653364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1393/2763] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:58.157723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:58.159245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:58.172283 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc80c48-2922-4c86-bb72-677df9b30517 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:58.178280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:58.178934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:58.179217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:58.179489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] PATH_INFO: `/v3/projects/d44d4817707043ccbc81b47686468ada` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:58.180678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44d4817707043ccbc81b47686468ada)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:58.183349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:58.346434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:58.352555 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44d4817707043ccbc81b47686468ada', 'request_id': 'req-e5eb3deb-c53b-4076-9f58-3d2f8f300634'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.359108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44d4817707043ccbc81b47686468ada', 'request_id': 'req-e5eb3deb-c53b-4076-9f58-3d2f8f300634'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.454058 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44d4817707043ccbc81b47686468ada', 'request_id': 'req-e5eb3deb-c53b-4076-9f58-3d2f8f300634'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.464705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] The token cache is being invalidate because project d44d4817707043ccbc81b47686468ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:58.465030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.465706 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.467280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1371/2764] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:58 2022] DELETE /identity/v3/projects/d44d4817707043ccbc81b47686468ada => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:58.471548 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:58.481710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da26d5-f67b-4ba0-871a-f49539fdfab9 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:58.539613 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:58.540236 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:58.540507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:58.540806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] PATH_INFO: `/v3/users/b962528f843048b8ad78218ca3b1e1c1` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:58.541915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b962528f843048b8ad78218ca3b1e1c1)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:58.543810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:58.782224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b962528f843048b8ad78218ca3b1e1c1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.782810 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b962528f843048b8ad78218ca3b1e1c1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.893382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b962528f843048b8ad78218ca3b1e1c1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.894020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b962528f843048b8ad78218ca3b1e1c1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.906443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b962528f843048b8ad78218ca3b1e1c1'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:58.926451 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1394/2765] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:58 2022] DELETE /identity/v3/users/b962528f843048b8ad78218ca3b1e1c1 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:59.426208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:59.426208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:59.449385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb3deb-c53b-4076-9f58-3d2f8f300634 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:59.518575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:59.519659 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:59.519981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:59.520154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] PATH_INFO: `/v3/projects/2ff1d788601e4330b96e8424cd903949` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:59.521636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff1d788601e4330b96e8424cd903949)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:59.523680 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:59.699139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff1d788601e4330b96e8424cd903949', 'request_id': 'req-b75f0143-f0b4-4bb7-b4f2-db8b70307978'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:59.709293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff1d788601e4330b96e8424cd903949', 'request_id': 'req-b75f0143-f0b4-4bb7-b4f2-db8b70307978'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:59.807150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff1d788601e4330b96e8424cd903949', 'request_id': 'req-b75f0143-f0b4-4bb7-b4f2-db8b70307978'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:59.822344 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] The token cache is being invalidate because project 2ff1d788601e4330b96e8424cd903949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:36:59.822643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:59.823593 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:36:59.829198 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1372/2766] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:36:59 2022] DELETE /identity/v3/projects/2ff1d788601e4330b96e8424cd903949 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:36:59.830188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:59.831722 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:59.846370 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa227f-fa12-4bc6-80c4-e93bd106ba1c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:59.850514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:59.933006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:59.934184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:59.934184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:59.934419 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] PATH_INFO: `/v3/users/99f4fd1ab68647a1867ab2ea7080278b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:59.935747 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f4fd1ab68647a1867ab2ea7080278b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:59.938405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:00.197623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f4fd1ab68647a1867ab2ea7080278b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:00.198365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f4fd1ab68647a1867ab2ea7080278b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:00.328447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f4fd1ab68647a1867ab2ea7080278b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:00.329396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f4fd1ab68647a1867ab2ea7080278b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:00.337655 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-eeb870c2-5010-4fc2-bea5-64af75a9a547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f4fd1ab68647a1867ab2ea7080278b'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:00.355992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1395/2767] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:36:59 2022] DELETE /identity/v3/users/99f4fd1ab68647a1867ab2ea7080278b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:00.821337 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:00.825474 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:00.836317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0143-f0b4-4bb7-b4f2-db8b70307978 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:00.903439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:00.904093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:00.904376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:00.904653 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] PATH_INFO: `/v3/projects/015ae8819a544786a3b4d678245eddbb` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:00.906000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] RBAC: Authorizing `identity:delete_project(project_id=015ae8819a544786a3b4d678245eddbb)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:00.908028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:00.910322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:01.012420 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015ae8819a544786a3b4d678245eddbb', 'request_id': 'req-0863b3f9-6b38-4318-b2c0-9495dc14835d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:01.020914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015ae8819a544786a3b4d678245eddbb', 'request_id': 'req-0863b3f9-6b38-4318-b2c0-9495dc14835d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:01.111941 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015ae8819a544786a3b4d678245eddbb', 'request_id': 'req-0863b3f9-6b38-4318-b2c0-9495dc14835d'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:01.133215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] The token cache is being invalidate because project 015ae8819a544786a3b4d678245eddbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:01.133780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:01.135258 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-0863b3f9-6b38-4318-b2c0-9495dc14835d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:01.147388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1373/2768] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:00 2022] DELETE /identity/v3/projects/015ae8819a544786a3b4d678245eddbb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:01.153209 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd23c-b447-4911-9c03-01f2c20abadf None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.154064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd23c-b447-4911-9c03-01f2c20abadf None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.154583 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dd23c-b447-4911-9c03-01f2c20abadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.178596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c36dd23c-b447-4911-9c03-01f2c20abadf None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:01.179829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c36dd23c-b447-4911-9c03-01f2c20abadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:01.248220 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1396/2769] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:01.318333 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895970-5d89-48ad-831a-cd3b78dd61a0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.318630 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895970-5d89-48ad-831a-cd3b78dd61a0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.318931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895970-5d89-48ad-831a-cd3b78dd61a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.339911 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b2895970-5d89-48ad-831a-cd3b78dd61a0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:01.341177 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b2895970-5d89-48ad-831a-cd3b78dd61a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:01.350772 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1374/2770] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:01.354438 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd23c-b447-4911-9c03-01f2c20abadf None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:01.365426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dd23c-b447-4911-9c03-01f2c20abadf None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:01.370253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:01.370878 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.371160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.371431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.372090 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:01.372394 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:01.374138 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:01.396328 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1397/2771] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:01.399342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895970-5d89-48ad-831a-cd3b78dd61a0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:01.411117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895970-5d89-48ad-831a-cd3b78dd61a0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:01.417311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:01.417929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.418212 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.418480 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.419131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:01.421217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:01.502688 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1375/2772] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:01 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:01.507162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:01.527832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86f56-beb5-4933-a5bb-4da7b55f4ccb admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:01.541432 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:01.597297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:01.598248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.598686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.599006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.599721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:01.602152 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:01.699587 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1398/2773] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:01 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:01.705141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:01.716880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6d2f0-bb0e-439a-b4b4-ab0886e88f1d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:01.729826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:01.730529 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.730881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.731160 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.731825 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:01.733576 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:01.745646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1376/2774] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:01.750947 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:01.763267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e502ff-de6c-43a9-9e16-bde7c96494cf admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:01.769761 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35165d90-faf5-41dc-b6eb-7943df84acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:01.770386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165d90-faf5-41dc-b6eb-7943df84acc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.770772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165d90-faf5-41dc-b6eb-7943df84acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.770937 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35165d90-faf5-41dc-b6eb-7943df84acc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.771576 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35165d90-faf5-41dc-b6eb-7943df84acc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:01.773294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35165d90-faf5-41dc-b6eb-7943df84acc2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:01.789739 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1399/2775] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:01.793840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:01.804342 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485b92-2111-49cb-808a-29267c86afe1 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:01.809408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:01.819308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.819308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.819308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] PATH_INFO: `/v3/projects/5550889570224781afe09cd5b36fd946/users/c3b7726bf81745f6a1dc88738fe617b7/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.827675 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5550889570224781afe09cd5b36fd946, user_id=c3b7726bf81745f6a1dc88738fe617b7, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:01.831051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:01.922845 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1377/2776] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:01 2022] PUT /identity/v3/projects/5550889570224781afe09cd5b36fd946/users/c3b7726bf81745f6a1dc88738fe617b7/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:01.944035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12a53-7c5b-4b6c-b645-5134bfaaee4b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:01.944319 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12a53-7c5b-4b6c-b645-5134bfaaee4b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:01.944595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12a53-7c5b-4b6c-b645-5134bfaaee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:01.980357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-91a12a53-7c5b-4b6c-b645-5134bfaaee4b None None] MFA Rules not processed for user `c3b7726bf81745f6a1dc88738fe617b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:01.981671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-91a12a53-7c5b-4b6c-b645-5134bfaaee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:02.049166 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1400/2777] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:02.060597 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:02.064103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:02.123020 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65491b79-0205-4605-b983-d6d1c7575227 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:02.128180 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54136-6226-4532-a8c9-f38c4c2270b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:02.128822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54136-6226-4532-a8c9-f38c4c2270b1 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:02.129105 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54136-6226-4532-a8c9-f38c4c2270b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:02.129376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54136-6226-4532-a8c9-f38c4c2270b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:02.143601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c54136-6226-4532-a8c9-f38c4c2270b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:02.143601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c54136-6226-4532-a8c9-f38c4c2270b1 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:02.148878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1378/2778] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:02.174358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12a53-7c5b-4b6c-b645-5134bfaaee4b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:02.243107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12a53-7c5b-4b6c-b645-5134bfaaee4b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:02.253023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:02.254100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:02.254597 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:02.255088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] PATH_INFO: `/v3/users/c3b7726bf81745f6a1dc88738fe617b7` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:02.257127 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b7726bf81745f6a1dc88738fe617b7)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:02.260664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:02.482764 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b7726bf81745f6a1dc88738fe617b7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:02.485097 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b7726bf81745f6a1dc88738fe617b7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:02.641896 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b7726bf81745f6a1dc88738fe617b7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:02.642531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b7726bf81745f6a1dc88738fe617b7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:02.654980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b7726bf81745f6a1dc88738fe617b7'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:02.676260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1401/2779] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:02 2022] DELETE /identity/v3/users/c3b7726bf81745f6a1dc88738fe617b7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:02.681294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:02.681610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:02.681959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:02.714257 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:02.715309 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:02.763519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:02.815812 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1379/2780] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:02.829337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:02.832646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:02.902741 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966d00-9346-441c-8142-b30c55b94459 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:02.908689 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35def8a-0078-4c94-bb76-3001c8dc9363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:02.909139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35def8a-0078-4c94-bb76-3001c8dc9363 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:02.909410 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35def8a-0078-4c94-bb76-3001c8dc9363 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:02.909681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35def8a-0078-4c94-bb76-3001c8dc9363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:02.919324 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35def8a-0078-4c94-bb76-3001c8dc9363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:02.920790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35def8a-0078-4c94-bb76-3001c8dc9363 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:02.932595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1402/2781] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:02.963022 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:03.398275 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:03.399873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:03.416587 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691e33d-5a4c-4868-a497-73f820d577b6 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:03.422128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:03.422780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:03.423319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:03.423319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] PATH_INFO: `/v3/projects/5550889570224781afe09cd5b36fd946` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:03.425730 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5550889570224781afe09cd5b36fd946)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:03.426589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:03.550490 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5550889570224781afe09cd5b36fd946', 'request_id': 'req-5126e620-d0d8-4013-a40d-1ce9ea569b82'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:03.558386 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5550889570224781afe09cd5b36fd946', 'request_id': 'req-5126e620-d0d8-4013-a40d-1ce9ea569b82'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:03.646902 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5550889570224781afe09cd5b36fd946', 'request_id': 'req-5126e620-d0d8-4013-a40d-1ce9ea569b82'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:03.658798 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] The token cache is being invalidate because project 5550889570224781afe09cd5b36fd946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:03.659084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:03.659773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-5126e620-d0d8-4013-a40d-1ce9ea569b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:03.661320 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1380/2782] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:03 2022] DELETE /identity/v3/projects/5550889570224781afe09cd5b36fd946 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:03.666495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567b19-6948-4809-a307-2940305c5e29 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:03.667035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567b19-6948-4809-a307-2940305c5e29 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:03.667266 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567b19-6948-4809-a307-2940305c5e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:03.690131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-c1567b19-6948-4809-a307-2940305c5e29 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:03.691535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c1567b19-6948-4809-a307-2940305c5e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:03.756143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1403/2783] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:03.766406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91934-749d-4061-beee-5f370d0ec5f2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:03.766694 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91934-749d-4061-beee-5f370d0ec5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:03.767000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab91934-749d-4061-beee-5f370d0ec5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:03.798633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-fab91934-749d-4061-beee-5f370d0ec5f2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:03.800023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-fab91934-749d-4061-beee-5f370d0ec5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:03.809813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1381/2784] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:03.815584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567b19-6948-4809-a307-2940305c5e29 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:03.826384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567b19-6948-4809-a307-2940305c5e29 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:03.831414 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:03.832026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:03.832311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:03.832584 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:03.833277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:03.833580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:03.835218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:03.847533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1404/2785] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:03.852424 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91934-749d-4061-beee-5f370d0ec5f2 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:03.863910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab91934-749d-4061-beee-5f370d0ec5f2 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:03.869100 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:03.869962 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:03.870085 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:03.870352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:03.870945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:03.872899 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:03.993898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1382/2786] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:04.000982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:04.016567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5f401-200f-484a-84a5-61077c1247bd admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:04.090516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:04.091129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:04.091534 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:04.091662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:04.092393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:04.095033 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:04.306540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1405/2787] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:03 2022] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:04.310742 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:04.322795 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb8c5-d56f-4e6b-8622-5b7c86c1ca4f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:04.328265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:04.328996 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:04.329277 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:04.329760 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:04.330789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:04.332418 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:04.348705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1383/2788] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:04.353378 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:04.369701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c88072-116c-45ab-a289-ebd996245961 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:04.389224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7b321-8d13-47e1-8f2c-e4bd92289bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:04.389224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7b321-8d13-47e1-8f2c-e4bd92289bee admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:04.389224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7b321-8d13-47e1-8f2c-e4bd92289bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:04.389224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7b321-8d13-47e1-8f2c-e4bd92289bee admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:04.389775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7b321-8d13-47e1-8f2c-e4bd92289bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:04.389775 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7b321-8d13-47e1-8f2c-e4bd92289bee admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:04.395278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1406/2789] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:04.401169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:04.413743 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7918cfe-fd9e-4aff-b4fd-1aada77a6580 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:04.418340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:04.419000 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:04.419279 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:04.419552 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] PATH_INFO: `/v3/projects/15a6e3ad3ace4b739e4a44ef92387f0a/users/6869386b6d824a60bb511151cf057c7d/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:04.436455 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a6e3ad3ace4b739e4a44ef92387f0a, user_id=6869386b6d824a60bb511151cf057c7d, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:04.439814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:04.597252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1384/2790] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:04 2022] PUT /identity/v3/projects/15a6e3ad3ace4b739e4a44ef92387f0a/users/6869386b6d824a60bb511151cf057c7d/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:04.607486 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:04.607773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:04.608049 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:04.637965 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] MFA Rules not processed for user `6869386b6d824a60bb511151cf057c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:04.639239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:04.717150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1407/2791] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:04.730132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:04.732525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:04.797347 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebb728-25cd-4909-85cf-b3ae55218162 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:04.801150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325094d-1fe9-48cd-afdf-ecaa7849cc43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:04.801762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325094d-1fe9-48cd-afdf-ecaa7849cc43 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:04.802043 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325094d-1fe9-48cd-afdf-ecaa7849cc43 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:04.802319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325094d-1fe9-48cd-afdf-ecaa7849cc43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:04.811321 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325094d-1fe9-48cd-afdf-ecaa7849cc43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:04.813851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325094d-1fe9-48cd-afdf-ecaa7849cc43 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:04.823769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1385/2792] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:05.003817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:05.144275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:05.939359 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:05.940815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:06.011140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6245bb-17c1-4469-b17b-8c4f541775b1 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:06.020823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:06.020823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:06.020823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:06.020823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] PATH_INFO: `/v3/users/8bdbcbe0f65d4ead84123d029029e203` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:06.021222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdbcbe0f65d4ead84123d029029e203)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:06.022215 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:06.306248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:06.311431 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdbcbe0f65d4ead84123d029029e203'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:06.313150 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdbcbe0f65d4ead84123d029029e203'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:06.454327 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdbcbe0f65d4ead84123d029029e203'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:06.455061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdbcbe0f65d4ead84123d029029e203'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:06.466608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdbcbe0f65d4ead84123d029029e203'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:06.488276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1408/2793] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:05 2022] DELETE /identity/v3/users/8bdbcbe0f65d4ead84123d029029e203 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:06.492984 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:06.493489 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:06.493589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:06.514570 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:06.516433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:06.576600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1386/2794] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:06.590123 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:06.592137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:06.656453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20680630-ac4c-432f-8bdd-47b2f3bcb74f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:06.660330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:06.660976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:06.661252 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:06.661522 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:06.670909 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:06.672625 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:06.682532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1409/2795] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:07.175192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:07.176832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:07.190561 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe48dc-ed1f-4f1d-9abb-368f328cc2a0 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:07.196864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:07.197804 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:07.198367 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:07.198828 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] PATH_INFO: `/v3/projects/ca1181b2824244dd873f296b49c60b7a` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:07.200290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1181b2824244dd873f296b49c60b7a)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:07.203580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:07.328891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1181b2824244dd873f296b49c60b7a', 'request_id': 'req-580632a7-bf53-4b19-87b6-a7867781e178'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.335693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1181b2824244dd873f296b49c60b7a', 'request_id': 'req-580632a7-bf53-4b19-87b6-a7867781e178'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.418672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1181b2824244dd873f296b49c60b7a', 'request_id': 'req-580632a7-bf53-4b19-87b6-a7867781e178'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.431152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] The token cache is being invalidate because project ca1181b2824244dd873f296b49c60b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:07.431434 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.432098 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-580632a7-bf53-4b19-87b6-a7867781e178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.433614 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1387/2796] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:07 2022] DELETE /identity/v3/projects/ca1181b2824244dd873f296b49c60b7a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:07.437876 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:07.447724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2d9da-997d-4fee-81b7-4eabd229ebf3 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:07.507816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:07.508455 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:07.508762 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:07.509043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] PATH_INFO: `/v3/users/e7155d3ea2c94ae491689fb6fb16e67d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:07.510254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7155d3ea2c94ae491689fb6fb16e67d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:07.512228 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:07.731907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7155d3ea2c94ae491689fb6fb16e67d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.732607 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7155d3ea2c94ae491689fb6fb16e67d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.824397 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7155d3ea2c94ae491689fb6fb16e67d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.978660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7155d3ea2c94ae491689fb6fb16e67d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.978660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7155d3ea2c94ae491689fb6fb16e67d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:07.978660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:07.978660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1410/2797] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:07 2022] DELETE /identity/v3/users/e7155d3ea2c94ae491689fb6fb16e67d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:07.979071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6579d-c1e2-4c7a-92ba-4a728278ba53 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:07.979071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6579d-c1e2-4c7a-92ba-4a728278ba53 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:07.979071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6579d-c1e2-4c7a-92ba-4a728278ba53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:07.979071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4eb6579d-c1e2-4c7a-92ba-4a728278ba53 None None] MFA Rules not processed for user `6869386b6d824a60bb511151cf057c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:07.979071 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4eb6579d-c1e2-4c7a-92ba-4a728278ba53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:07.993716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1388/2798] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:08.410516 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:08.421927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:08.493129 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd2ad-dbd4-4959-b87d-f79f157dbbb1 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:08.498246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:08.498891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:08.499233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:08.500024 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] PATH_INFO: `/v3/projects/3b7c8d3965d443ddb92503b880bf416b` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:08.501232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7c8d3965d443ddb92503b880bf416b)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:08.503218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:08.639888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7c8d3965d443ddb92503b880bf416b', 'request_id': 'req-f9ccf194-1540-47f0-b555-1fe2e645d865'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:08.647143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7c8d3965d443ddb92503b880bf416b', 'request_id': 'req-f9ccf194-1540-47f0-b555-1fe2e645d865'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:08.654255 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7c8d3965d443ddb92503b880bf416b', 'request_id': 'req-f9ccf194-1540-47f0-b555-1fe2e645d865'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:08.763284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] The token cache is being invalidate because project 3b7c8d3965d443ddb92503b880bf416b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:08.763284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:08.763284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-f9ccf194-1540-47f0-b555-1fe2e645d865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:08.764386 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1411/2799] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:08 2022] DELETE /identity/v3/projects/3b7c8d3965d443ddb92503b880bf416b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:08.770863 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab7a03-38bd-4f61-93f6-3132c4be0078 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:08.771240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab7a03-38bd-4f61-93f6-3132c4be0078 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:08.771682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab7a03-38bd-4f61-93f6-3132c4be0078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:08.806467 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-63ab7a03-38bd-4f61-93f6-3132c4be0078 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:08.807691 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-63ab7a03-38bd-4f61-93f6-3132c4be0078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:08.832117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:08.892245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1389/2800] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:08.900027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329718a-0116-4aaa-862f-08a997dd819c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:08.904501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329718a-0116-4aaa-862f-08a997dd819c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:08.904501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329718a-0116-4aaa-862f-08a997dd819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:08.932309 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-8329718a-0116-4aaa-862f-08a997dd819c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:08.933569 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8329718a-0116-4aaa-862f-08a997dd819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:08.944806 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1412/2801] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:08.948703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab7a03-38bd-4f61-93f6-3132c4be0078 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:08.966583 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab7a03-38bd-4f61-93f6-3132c4be0078 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:08.974464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:08.975082 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:08.977114 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:08.981995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:08.981995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:08.981995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:08.981995 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:09.001414 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1390/2802] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:09.002046 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329718a-0116-4aaa-862f-08a997dd819c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:09.012836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329718a-0116-4aaa-862f-08a997dd819c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:09.018709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:09.019759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:09.019759 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:09.019976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:09.020462 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:09.022391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:09.116308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1413/2803] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:09 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:09.117652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:09.129889 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2799e28-df25-403f-a559-583eab252208 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:09.197826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:09.198444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:09.198722 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:09.198993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:09.199639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:09.201617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:09.358381 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1391/2804] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:09 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:09.364076 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:09.383991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ceaac-deb1-4cd0-9e0c-aaf66f209bc2 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:09.391550 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:09.392183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:09.392459 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:09.392788 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:09.393448 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:09.395143 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:09.407690 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1414/2805] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:09.412780 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:09.424402 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be425a1-73c1-4376-8ec6-3d25dd528c0f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:09.430359 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e7be4-64c5-4bdc-978c-eb0c42676e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:09.431189 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7be4-64c5-4bdc-978c-eb0c42676e34 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:09.431580 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7be4-64c5-4bdc-978c-eb0c42676e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:09.431939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7be4-64c5-4bdc-978c-eb0c42676e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:09.432627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e7be4-64c5-4bdc-978c-eb0c42676e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:09.434643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e7be4-64c5-4bdc-978c-eb0c42676e34 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:09.451358 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1392/2806] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:09.456149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:09.466468 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a444856-88ad-4ccc-92df-52e2f496880a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:09.471980 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:09.472743 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:09.472967 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:09.473241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] PATH_INFO: `/v3/projects/94eb28a80ea8441c8fa1144b32999ebd/users/9e725c71bad34a8182fc0f68b177ac18/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:09.494608 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94eb28a80ea8441c8fa1144b32999ebd, user_id=9e725c71bad34a8182fc0f68b177ac18, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:09.497606 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:09.587546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1415/2807] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:09 2022] PUT /identity/v3/projects/94eb28a80ea8441c8fa1144b32999ebd/users/9e725c71bad34a8182fc0f68b177ac18/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:09.597916 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1242-9b9d-4c86-8052-d028018142a6 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:09.598380 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1242-9b9d-4c86-8052-d028018142a6 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:09.598565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1242-9b9d-4c86-8052-d028018142a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:09.636217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-645c1242-9b9d-4c86-8052-d028018142a6 None None] MFA Rules not processed for user `9e725c71bad34a8182fc0f68b177ac18`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:09.639196 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-645c1242-9b9d-4c86-8052-d028018142a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:09.716138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1393/2808] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:09.723469 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:09.733960 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:09.802002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd4450-33b5-4519-8185-7d9eb200eb2f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:09.807972 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:09.808610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:09.808961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:09.809254 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:09.809950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:09.812225 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.028903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1416/2809] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:09 2022] POST /identity/v3/projects => generated 379 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:10.035482 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c1242-9b9d-4c86-8052-d028018142a6 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:10.054227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c1242-9b9d-4c86-8052-d028018142a6 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:10.076846 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:10.136389 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:10.137045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.137321 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.137596 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.138360 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:10.143578 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.310061 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1394/2810] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:10 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:10.314823 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:10.325182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bcb4-58e1-4d7d-b401-eca1d0b52cf6 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:10.330672 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:10.331292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.331564 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.331831 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.332471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:10.334136 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.346600 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1417/2811] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:10.350872 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:10.362138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc98e17-863c-4276-bda8-5187cde3da0f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:10.367128 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:10.367877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.368159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.368435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] PATH_INFO: `/v3/projects/8610ba0d48ed46b0ae28e83086886f16/users/5887b04574974f7c8e218c0f1c513aac/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.384665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8610ba0d48ed46b0ae28e83086886f16, user_id=5887b04574974f7c8e218c0f1c513aac, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:10.387350 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.516589 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1395/2812] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:10 2022] PUT /identity/v3/projects/8610ba0d48ed46b0ae28e83086886f16/users/5887b04574974f7c8e218c0f1c513aac/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:10.520555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:10.531966 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9043cb-41cf-4181-b594-dd7f1408660c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:10.591682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd64967-4ace-4e4a-aa35-22eec9e01956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:10.592224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64967-4ace-4e4a-aa35-22eec9e01956 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.592596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64967-4ace-4e4a-aa35-22eec9e01956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.592862 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64967-4ace-4e4a-aa35-22eec9e01956 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.593514 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd64967-4ace-4e4a-aa35-22eec9e01956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:10.595206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd64967-4ace-4e4a-aa35-22eec9e01956 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.606330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1418/2813] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:10.611456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:10.622287 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b2570-de93-4132-a30c-31c0aaa9b210 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:10.629273 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:10.629952 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.630232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.630505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] PATH_INFO: `/v3/projects/8610ba0d48ed46b0ae28e83086886f16/users/5887b04574974f7c8e218c0f1c513aac/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.632487 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8610ba0d48ed46b0ae28e83086886f16, user_id=5887b04574974f7c8e218c0f1c513aac, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:10.635242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.646643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1396/2814] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:10 2022] PUT /identity/v3/projects/8610ba0d48ed46b0ae28e83086886f16/users/5887b04574974f7c8e218c0f1c513aac/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:10.658392 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc057f-7add-4f05-90a4-02548deabf24 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.658687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc057f-7add-4f05-90a4-02548deabf24 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.658969 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc057f-7add-4f05-90a4-02548deabf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.689510 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-02fc057f-7add-4f05-90a4-02548deabf24 None None] MFA Rules not processed for user `5887b04574974f7c8e218c0f1c513aac`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:10.691000 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-02fc057f-7add-4f05-90a4-02548deabf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:10.773681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1419/2815] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:10.782481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:10.784908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:10.852028 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2608569-8acc-4ade-9f16-e81d98d1fee8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:10.856109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:10.856865 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.857144 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.857444 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.926599 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:10.928044 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.939613 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1397/2816] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:14.094790 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc057f-7add-4f05-90a4-02548deabf24 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:14.099772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:14.114336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc057f-7add-4f05-90a4-02548deabf24 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:14.120594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:14.121485 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:14.121890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:14.122154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:14.134383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:14.136365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:14.150952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1420/2817] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:15.154419 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:15.156042 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:15.199789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:15.265433 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2642e-047f-436d-ae73-4ed1cc0066ee service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:15.272645 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eebbd-059f-4e0e-96d8-91cd0b3f668f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:15.274281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eebbd-059f-4e0e-96d8-91cd0b3f668f service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:15.274281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eebbd-059f-4e0e-96d8-91cd0b3f668f service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:15.274281 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eebbd-059f-4e0e-96d8-91cd0b3f668f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:15.278216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-747eebbd-059f-4e0e-96d8-91cd0b3f668f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:15.299716 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747eebbd-059f-4e0e-96d8-91cd0b3f668f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:15.301376 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747eebbd-059f-4e0e-96d8-91cd0b3f668f service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:15.313875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1398/2818] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:19.839708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:19.929649 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41f3e6-84c8-4c46-a5e2-ef691c3425fe service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:19.934646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:19.935275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:19.935552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:19.935825 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] PATH_INFO: `/v3/users/9e725c71bad34a8182fc0f68b177ac18` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:19.937719 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e725c71bad34a8182fc0f68b177ac18)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:19.939664 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.198665 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e725c71bad34a8182fc0f68b177ac18'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:20.199390 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e725c71bad34a8182fc0f68b177ac18'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:20.292991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e725c71bad34a8182fc0f68b177ac18'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:20.293653 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e725c71bad34a8182fc0f68b177ac18'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:20.306365 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e725c71bad34a8182fc0f68b177ac18'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:20.326445 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1421/2819] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:19 2022] DELETE /identity/v3/users/9e725c71bad34a8182fc0f68b177ac18 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:20.333951 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.334707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.334707 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.356621 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:20.357891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:20.440672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1399/2820] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:20.451027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.452717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:20.517476 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22403b16-0808-4b87-b5ea-613adab8bd8c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.522383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.526800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.526800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.526800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.535091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:20.536639 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.547435 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1422/2821] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:21.151950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:21.153703 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:21.170086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834d57-2545-4ed5-9ec2-e969c4a319db None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:21.177271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:21.177925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:21.178199 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:21.178476 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] PATH_INFO: `/v3/projects/94eb28a80ea8441c8fa1144b32999ebd` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:21.179717 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94eb28a80ea8441c8fa1144b32999ebd)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:21.181808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:21.339053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94eb28a80ea8441c8fa1144b32999ebd', 'request_id': 'req-de8eaf7c-3e15-4869-b396-ed68eaf65609'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.347051 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94eb28a80ea8441c8fa1144b32999ebd', 'request_id': 'req-de8eaf7c-3e15-4869-b396-ed68eaf65609'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.447291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94eb28a80ea8441c8fa1144b32999ebd', 'request_id': 'req-de8eaf7c-3e15-4869-b396-ed68eaf65609'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.461456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] The token cache is being invalidate because project 94eb28a80ea8441c8fa1144b32999ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:21.461981 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.463048 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.465673 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1400/2822] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:21 2022] DELETE /identity/v3/projects/94eb28a80ea8441c8fa1144b32999ebd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:21.471436 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:21.481350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338e67-9693-4485-9ea1-70a6e38bcf80 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:21.490851 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:21.555296 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:21.555948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:21.556218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:21.556487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] PATH_INFO: `/v3/users/5887b04574974f7c8e218c0f1c513aac` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:21.557756 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5887b04574974f7c8e218c0f1c513aac)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:21.559715 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:21.852183 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5887b04574974f7c8e218c0f1c513aac'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.855884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5887b04574974f7c8e218c0f1c513aac'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.966792 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:21.969568 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:21.978457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5887b04574974f7c8e218c0f1c513aac'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.980050 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5887b04574974f7c8e218c0f1c513aac'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:21.990020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5887b04574974f7c8e218c0f1c513aac'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:22.014107 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1423/2823] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:21 2022] DELETE /identity/v3/users/5887b04574974f7c8e218c0f1c513aac => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:22.018150 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:22.069464 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eaf7c-3e15-4869-b396-ed68eaf65609 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:22.147877 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6a07-9278-4639-96f0-0eb92c06f6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:22.148574 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6a07-9278-4639-96f0-0eb92c06f6b2 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:22.148892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6a07-9278-4639-96f0-0eb92c06f6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:22.149173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6a07-9278-4639-96f0-0eb92c06f6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:22.151264 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-d77f6a07-9278-4639-96f0-0eb92c06f6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:22.165213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6a07-9278-4639-96f0-0eb92c06f6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:22.166925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6a07-9278-4639-96f0-0eb92c06f6b2 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:22.179054 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1401/2824] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:22.491800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:22.491800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:22.576257 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157fcaf-8baf-43ee-a9a3-6ed4c22e18fb admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:22.582905 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:22.583551 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:22.583867 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:22.584132 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] PATH_INFO: `/v3/projects/8610ba0d48ed46b0ae28e83086886f16` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:22.585304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8610ba0d48ed46b0ae28e83086886f16)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:22.587222 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:22.736171 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:22.752670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8610ba0d48ed46b0ae28e83086886f16', 'request_id': 'req-d73a79ab-9c03-4086-96d9-367a46857c0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:22.759139 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8610ba0d48ed46b0ae28e83086886f16', 'request_id': 'req-d73a79ab-9c03-4086-96d9-367a46857c0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:22.772847 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8610ba0d48ed46b0ae28e83086886f16', 'request_id': 'req-d73a79ab-9c03-4086-96d9-367a46857c0f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:22.847586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] The token cache is being invalidate because project 8610ba0d48ed46b0ae28e83086886f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:22.847886 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:22.848532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d73a79ab-9c03-4086-96d9-367a46857c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:22.850206 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1424/2825] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:22 2022] DELETE /identity/v3/projects/8610ba0d48ed46b0ae28e83086886f16 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:22.855154 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0a1d-07b6-44b1-8d05-6794fa8e1e4e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:22.855646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0a1d-07b6-44b1-8d05-6794fa8e1e4e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:22.855746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0a1d-07b6-44b1-8d05-6794fa8e1e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:22.877553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-f4ba0a1d-07b6-44b1-8d05-6794fa8e1e4e None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:22.878784 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-f4ba0a1d-07b6-44b1-8d05-6794fa8e1e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:22.949388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1402/2826] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:22.958773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13c38c-2388-4c40-8788-478169b4380b None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:22.959055 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13c38c-2388-4c40-8788-478169b4380b None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:22.959331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13c38c-2388-4c40-8788-478169b4380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:22.981061 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4e13c38c-2388-4c40-8788-478169b4380b None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:22.985164 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4e13c38c-2388-4c40-8788-478169b4380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:22.990879 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1425/2827] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:22.995227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0a1d-07b6-44b1-8d05-6794fa8e1e4e None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:23.012139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0a1d-07b6-44b1-8d05-6794fa8e1e4e None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:23.017652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:23.018423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.018704 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.018975 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.019635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:23.019939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:23.021600 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:23.036839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1403/2828] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:23.041443 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13c38c-2388-4c40-8788-478169b4380b None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:23.051768 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13c38c-2388-4c40-8788-478169b4380b None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:23.057344 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:23.057961 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.058238 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.058508 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.059172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:23.061149 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:23.226276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1426/2829] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:23.231341 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:23.243063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d1684-d34f-4862-93f9-251fc7ab2313 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:23.296095 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:23.320670 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:23.321535 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.321884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.322204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.323172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:23.325290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:23.430361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1404/2830] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:23 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:23.436364 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:23.448710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94b482-8f7c-4cba-868c-78ad0ecfded0 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:23.458153 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:23.458908 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.459185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.459461 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.460109 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:23.461800 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:23.476128 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1427/2831] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:23.480928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:23.492925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e32b44-c077-4518-b259-bf897ae5adcc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:23.498112 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33d65d-9b12-4956-a322-26714c4595b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:23.499365 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d65d-9b12-4956-a322-26714c4595b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.499794 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d65d-9b12-4956-a322-26714c4595b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.500081 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d65d-9b12-4956-a322-26714c4595b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.500813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33d65d-9b12-4956-a322-26714c4595b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:23.502601 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33d65d-9b12-4956-a322-26714c4595b7 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:23.515084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1405/2832] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:23.520162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:23.532250 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26601d06-aadd-434c-a3ec-c1c77c572e29 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:23.537027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:23.537688 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.537963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.538230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] PATH_INFO: `/v3/projects/750598e15ae74a34b0a7bcb6b6e100ff/users/38fe6a983a5e42e78e1ce8bfba96da70/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.559202 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=750598e15ae74a34b0a7bcb6b6e100ff, user_id=38fe6a983a5e42e78e1ce8bfba96da70, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:23.563318 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:23.677195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1428/2833] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:23 2022] PUT /identity/v3/projects/750598e15ae74a34b0a7bcb6b6e100ff/users/38fe6a983a5e42e78e1ce8bfba96da70/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:23.688758 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66584703-405a-482a-bd73-bca1f5b822c9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.689039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66584703-405a-482a-bd73-bca1f5b822c9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.689311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66584703-405a-482a-bd73-bca1f5b822c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.722039 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-66584703-405a-482a-bd73-bca1f5b822c9 None None] MFA Rules not processed for user `38fe6a983a5e42e78e1ce8bfba96da70`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:23.723310 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-66584703-405a-482a-bd73-bca1f5b822c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:23.805864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1406/2834] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:23.815610 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:23.897026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57236-fdda-4963-b1d7-d7085c0ab9fb admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:23.902799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:23.903519 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:23.903814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:23.904083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:23.904750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:23.906906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:24.052160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1429/2835] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:24.056335 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66584703-405a-482a-bd73-bca1f5b822c9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:24.069548 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66584703-405a-482a-bd73-bca1f5b822c9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:24.134030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:24.134627 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:24.134903 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:24.135169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:24.135796 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:24.137766 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:24.261853 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1407/2836] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:24 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:24.263880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:24.276556 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da8fc-58e8-44e8-8b76-180ebc4c4c73 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:24.282095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:24.282877 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:24.283294 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:24.283666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:24.284396 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:24.286067 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:24.299035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1430/2837] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:24.303316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:24.314829 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816963f-9543-49ae-8808-b50ca7f62ffa admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:24.319754 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ee6f5-52fc-4c56-90d9-d937770f489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:24.320356 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee6f5-52fc-4c56-90d9-d937770f489e admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:24.320635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee6f5-52fc-4c56-90d9-d937770f489e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:24.320943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee6f5-52fc-4c56-90d9-d937770f489e admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:24.321592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ee6f5-52fc-4c56-90d9-d937770f489e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:24.323242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ee6f5-52fc-4c56-90d9-d937770f489e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:24.341151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1408/2838] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:24.343416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:24.365558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb8dfc-9c44-48ea-af1d-875316a55fae admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:24.374795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:24.375958 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:24.378701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:24.378701 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] PATH_INFO: `/v3/projects/9988c9a5909f48dc983f9607a080c539/users/0eeb8dcfb2f540a29db0752d32a54469/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:24.407990 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9988c9a5909f48dc983f9607a080c539, user_id=0eeb8dcfb2f540a29db0752d32a54469, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:24.413586 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:24.506241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1431/2839] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:24 2022] PUT /identity/v3/projects/9988c9a5909f48dc983f9607a080c539/users/0eeb8dcfb2f540a29db0752d32a54469/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:24.589032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716c9ff-68c9-4805-92c1-d8be81a91022 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:24.589435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716c9ff-68c9-4805-92c1-d8be81a91022 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:24.589928 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716c9ff-68c9-4805-92c1-d8be81a91022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:24.628549 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-5716c9ff-68c9-4805-92c1-d8be81a91022 None None] MFA Rules not processed for user `0eeb8dcfb2f540a29db0752d32a54469`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:24.630272 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5716c9ff-68c9-4805-92c1-d8be81a91022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:24.651322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:24.713551 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1409/2840] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:24.719687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:24.732863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:24.804140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b3c8-cdba-44e5-9da8-e07507ac7dd4 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:24.809124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:24.809740 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:24.810088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:24.810480 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:24.810982 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:24.814633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:24.969648 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1432/2841] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:24 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:24.974127 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716c9ff-68c9-4805-92c1-d8be81a91022 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:24.992693 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716c9ff-68c9-4805-92c1-d8be81a91022 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:25.083457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:25.084521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.085064 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.085655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.088221 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:25.093268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:25.227393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1410/2842] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:24 2022] POST /identity/v3/users => generated 300 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:25.231785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:25.243517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84807d9b-c609-48dc-bab5-c80483aa5209 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:25.249098 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:25.249779 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.250110 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.250428 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.251134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:25.252789 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:25.268676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1433/2843] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:25.276005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:25.288931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f5dad-3b26-42ae-8475-d7b171a22327 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:25.293965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:25.294643 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.295103 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.295385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] PATH_INFO: `/v3/projects/cf7e5fb27b6c4223a38b90563e2164bd/users/77aaca4ac60f4c88bd3efac47b0a846c/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.315110 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7e5fb27b6c4223a38b90563e2164bd, user_id=77aaca4ac60f4c88bd3efac47b0a846c, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:25.317993 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:25.429301 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1411/2844] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:25 2022] PUT /identity/v3/projects/cf7e5fb27b6c4223a38b90563e2164bd/users/77aaca4ac60f4c88bd3efac47b0a846c/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:25.430694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:25.441950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43d95-a501-4b70-ad40-67c1d8fb072c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:25.513787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cca1f6-f1b7-4413-a9d2-e186c11a3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:25.518276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cca1f6-f1b7-4413-a9d2-e186c11a3f71 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.518276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cca1f6-f1b7-4413-a9d2-e186c11a3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.518276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cca1f6-f1b7-4413-a9d2-e186c11a3f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.518276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cca1f6-f1b7-4413-a9d2-e186c11a3f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:25.518276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cca1f6-f1b7-4413-a9d2-e186c11a3f71 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:25.529951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1434/2845] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:37:25.534914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:25.545789 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00264c-781d-4ed2-80a4-e310247fbeb5 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:25.550700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:25.551370 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.551636 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.551909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] PATH_INFO: `/v3/projects/cf7e5fb27b6c4223a38b90563e2164bd/users/77aaca4ac60f4c88bd3efac47b0a846c/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.553931 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7e5fb27b6c4223a38b90563e2164bd, user_id=77aaca4ac60f4c88bd3efac47b0a846c, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:25.556615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:25.568590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1412/2846] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:25 2022] PUT /identity/v3/projects/cf7e5fb27b6c4223a38b90563e2164bd/users/77aaca4ac60f4c88bd3efac47b0a846c/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:25.585971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.585971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.585971 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.639326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] MFA Rules not processed for user `77aaca4ac60f4c88bd3efac47b0a846c`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:25.641964 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:25.761496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1435/2847] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:25.775270 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:25.778080 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:25.852677 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494862b0-447e-4578-8672-a17c9dbea2c2 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:25.858077 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321a80-b0a1-42d1-b749-ae976eb2bfbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:25.859169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321a80-b0a1-42d1-b749-ae976eb2bfbc service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.859592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321a80-b0a1-42d1-b749-ae976eb2bfbc service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.859878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321a80-b0a1-42d1-b749-ae976eb2bfbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.870527 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321a80-b0a1-42d1-b749-ae976eb2bfbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:25.871997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321a80-b0a1-42d1-b749-ae976eb2bfbc service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:25.882705 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1413/2848] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:27.853169 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:27.854134 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:27.861738 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:27.871530 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb05f8-2f2f-4529-8db1-ca2792a95084 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:27.875642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:27.876285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:27.876567 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:27.876884 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:27.944987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:27.946622 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:27.963027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1436/2849] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:32.561862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691500ed-621e-4a63-9ace-8d0fa37f520e None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:32.562515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691500ed-621e-4a63-9ace-8d0fa37f520e None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:32.562515 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691500ed-621e-4a63-9ace-8d0fa37f520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:32.589481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:32.627159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-691500ed-621e-4a63-9ace-8d0fa37f520e None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:32.628453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-691500ed-621e-4a63-9ace-8d0fa37f520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:32.717416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1414/2850] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:32.899003 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:32.908117 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:33.006863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24f15-ffe3-474d-9273-b9427cc07652 service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.012497 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.013140 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.013421 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.013695 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.023360 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.025014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.034995 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1437/2851] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:37:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:33.502695 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c15a-fbd7-4f4b-ad92-94225b97fff0 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.504134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c15a-fbd7-4f4b-ad92-94225b97fff0 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.504682 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c15a-fbd7-4f4b-ad92-94225b97fff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.542438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-cd52c15a-fbd7-4f4b-ad92-94225b97fff0 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:33.543604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-cd52c15a-fbd7-4f4b-ad92-94225b97fff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:33.620190 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1415/2852] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:33.647286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.650032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:33.784568 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a69d5-4527-40fb-a521-20d57eed379c service swift] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.794906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.795816 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.796270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.796694 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.807711 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=100 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:33.811750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.814660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.830329 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1438/2853] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:34.358173 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f34b2b-ba23-42bd-9a56-51f06cce504a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.358711 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f34b2b-ba23-42bd-9a56-51f06cce504a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.359184 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f34b2b-ba23-42bd-9a56-51f06cce504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.382246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-67f34b2b-ba23-42bd-9a56-51f06cce504a None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:34.383554 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-67f34b2b-ba23-42bd-9a56-51f06cce504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:34.394192 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1416/2854] 10.222.0.71 () {58 vars in 967 bytes} [Fri Sep 2 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:34.409674 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.422457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58bd6d-bd0d-4f50-99d8-d47a5f2454a8 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.427946 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.429133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.429133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.429133 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.440942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.443056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.454188 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1439/2855] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:37:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:35.462543 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aa63c-c41f-466c-b75f-35bb0c46d1fc None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:35.463240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aa63c-c41f-466c-b75f-35bb0c46d1fc None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:35.463240 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aa63c-c41f-466c-b75f-35bb0c46d1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:35.485183 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-749aa63c-c41f-466c-b75f-35bb0c46d1fc None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:35.486435 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-749aa63c-c41f-466c-b75f-35bb0c46d1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:35.494094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1417/2856] 10.222.0.71 () {58 vars in 1009 bytes} [Fri Sep 2 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:35.507131 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:35.518792 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724e76-a048-44c6-95eb-20c1b6c42728 service swift] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:35.524068 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f43bd3-12f1-4d0f-863c-63677063d5a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:35.524710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f43bd3-12f1-4d0f-863c-63677063d5a2 service swift] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:35.525091 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f43bd3-12f1-4d0f-863c-63677063d5a2 service swift] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:35.525368 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f43bd3-12f1-4d0f-863c-63677063d5a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:35.539256 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f43bd3-12f1-4d0f-863c-63677063d5a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:35.541226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f43bd3-12f1-4d0f-863c-63677063d5a2 service swift] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:35.555229 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1440/2857] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:35.558625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aa63c-c41f-466c-b75f-35bb0c46d1fc None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:35.574466 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aa63c-c41f-466c-b75f-35bb0c46d1fc None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:35.579185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:35.580113 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:35.580566 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:35.581119 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:35.648839 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:35.650213 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:35.661458 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1418/2858] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:37:36.525609 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a055b-2f27-42bd-9065-46cf443efcf5 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:36.526391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a055b-2f27-42bd-9065-46cf443efcf5 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:36.526614 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a055b-2f27-42bd-9065-46cf443efcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:36.550582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4c1a055b-2f27-42bd-9065-46cf443efcf5 None None] MFA Rules not processed for user `4e11476429d84a6ba6ed2b9b71d28507`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:36.551984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4c1a055b-2f27-42bd-9065-46cf443efcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:36.563714 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1441/2859] 10.222.0.71 () {58 vars in 967 bytes} [Fri Sep 2 21:37:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:36.581755 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:36.597438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95f438-b36a-48f5-8c2e-eba79323952f service cinder] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:36.604004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27594eb14cf742ce8bcf21cdb8db5ef6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:36.606316 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:36.610725 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:36.611507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:36.640318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:36.643373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:36.650481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=100 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:36.659851 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1419/2860] 10.222.0.71 () {60 vars in 1384 bytes} [Fri Sep 2 21:37:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:39.002154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:39.003105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:39.003105 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:39.025235 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:39.026730 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:39.036661 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1442/2861] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:39.070083 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:39.072246 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:39.094523 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c5d6b-0d83-4647-aae2-74a68041d18b service swift] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:39.103271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eb5ae-4b70-4238-9110-f67ffaef2807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:39.103896 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eb5ae-4b70-4238-9110-f67ffaef2807 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:39.104178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eb5ae-4b70-4238-9110-f67ffaef2807 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:39.104452 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eb5ae-4b70-4238-9110-f67ffaef2807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:39.114271 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eb5ae-4b70-4238-9110-f67ffaef2807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:39.115871 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71eb5ae-4b70-4238-9110-f67ffaef2807 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:39.126416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1420/2862] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:40.272035 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:40.273496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:40.286416 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993af47-f02b-4364-9b76-d48a4485cb5c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:40.291125 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:40.291721 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:40.292005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:40.292283 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] PATH_INFO: `/v3/users/6869386b6d824a60bb511151cf057c7d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:40.293528 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6869386b6d824a60bb511151cf057c7d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:40.296043 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:40.688678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6869386b6d824a60bb511151cf057c7d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:40.689478 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6869386b6d824a60bb511151cf057c7d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:40.796949 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6869386b6d824a60bb511151cf057c7d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:40.797918 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6869386b6d824a60bb511151cf057c7d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:40.806092 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6869386b6d824a60bb511151cf057c7d'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:40.826915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1443/2863] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:40 2022] DELETE /identity/v3/users/6869386b6d824a60bb511151cf057c7d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:40.831610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d267085-fb26-4233-8c41-1547890447fe None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:40.832472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d267085-fb26-4233-8c41-1547890447fe None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:40.832472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d267085-fb26-4233-8c41-1547890447fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:40.862408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4d267085-fb26-4233-8c41-1547890447fe None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:40.863860 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4d267085-fb26-4233-8c41-1547890447fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:40.943824 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1421/2864] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:40.954415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:40.955890 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:41.033602 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0572a-5ae6-4a71-9c5a-07ddff5edb37 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:41.037456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:41.038075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:41.038357 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:41.038637 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:41.049799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:41.051271 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:41.063457 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1444/2865] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:41.396927 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d267085-fb26-4233-8c41-1547890447fe None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:41.400197 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4d267085-fb26-4233-8c41-1547890447fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:41.418131 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d267085-fb26-4233-8c41-1547890447fe None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:41.426261 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:41.427317 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:41.427623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:41.427946 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] PATH_INFO: `/v3/projects/15a6e3ad3ace4b739e4a44ef92387f0a` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:41.429741 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a6e3ad3ace4b739e4a44ef92387f0a)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:41.431520 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:41.470376 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:41.471948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:41.489181 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34e9d-5263-4c7e-8cd2-37228dc300d5 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:41.496226 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:41.496913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:41.497218 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:41.497492 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] PATH_INFO: `/v3/users/38fe6a983a5e42e78e1ce8bfba96da70` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:41.500010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fe6a983a5e42e78e1ce8bfba96da70)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:41.501208 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:41.599999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a6e3ad3ace4b739e4a44ef92387f0a', 'request_id': 'req-45748dca-5e44-4939-8285-02c3fde4a0d9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:41.608227 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a6e3ad3ace4b739e4a44ef92387f0a', 'request_id': 'req-45748dca-5e44-4939-8285-02c3fde4a0d9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:41.627880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:41.761710 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a6e3ad3ace4b739e4a44ef92387f0a', 'request_id': 'req-45748dca-5e44-4939-8285-02c3fde4a0d9'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:41.776135 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] The token cache is being invalidate because project 15a6e3ad3ace4b739e4a44ef92387f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:41.776644 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:41.777398 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-45748dca-5e44-4939-8285-02c3fde4a0d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:41.778937 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1422/2866] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:41 2022] DELETE /identity/v3/projects/15a6e3ad3ace4b739e4a44ef92387f0a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:41.847502 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fe6a983a5e42e78e1ce8bfba96da70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:41.848204 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fe6a983a5e42e78e1ce8bfba96da70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:42.024002 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fe6a983a5e42e78e1ce8bfba96da70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:42.025006 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fe6a983a5e42e78e1ce8bfba96da70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:42.034554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fe6a983a5e42e78e1ce8bfba96da70'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:42.059198 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1445/2867] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:41 2022] DELETE /identity/v3/users/38fe6a983a5e42e78e1ce8bfba96da70 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:42.065422 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:42.065976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:42.065976 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:42.088945 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:42.090428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:42.161727 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1423/2868] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:42.173708 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:42.175304 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:42.246119 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6631a-08b1-453f-90e0-0fe60ba77636 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:42.250717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:42.251330 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:42.251618 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:42.254667 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:42.262239 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:42.264279 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:42.275241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1446/2869] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:37:42.744959 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:42.747528 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:42.777375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e8ef-16a6-4247-89a1-50c9ff16b8a6 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:42.784236 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:42.784808 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:42.787291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:42.787291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] PATH_INFO: `/v3/projects/750598e15ae74a34b0a7bcb6b6e100ff` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:42.787291 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=750598e15ae74a34b0a7bcb6b6e100ff)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:42.788817 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:42.791999 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:42.906940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750598e15ae74a34b0a7bcb6b6e100ff', 'request_id': 'req-b93e8032-2bc3-44b0-9690-dd445a3de0ed'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:42.914678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750598e15ae74a34b0a7bcb6b6e100ff', 'request_id': 'req-b93e8032-2bc3-44b0-9690-dd445a3de0ed'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.053217 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750598e15ae74a34b0a7bcb6b6e100ff', 'request_id': 'req-b93e8032-2bc3-44b0-9690-dd445a3de0ed'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.066052 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] The token cache is being invalidate because project 750598e15ae74a34b0a7bcb6b6e100ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:43.066718 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.066836 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b93e8032-2bc3-44b0-9690-dd445a3de0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.068581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1424/2870] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:42 2022] DELETE /identity/v3/projects/750598e15ae74a34b0a7bcb6b6e100ff => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:43.074533 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:43.093276 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648e070-4853-43b2-a4eb-65f8daafe15b service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:43.175658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:43.176389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:43.176595 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:43.176904 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] PATH_INFO: `/v3/users/0eeb8dcfb2f540a29db0752d32a54469` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:43.178231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eeb8dcfb2f540a29db0752d32a54469)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:43.181824 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:43.527852 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eeb8dcfb2f540a29db0752d32a54469'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.528500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eeb8dcfb2f540a29db0752d32a54469'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.530536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:43.610620 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:43.610914 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:43.611186 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:43.632930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:43.634669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:43.639326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eeb8dcfb2f540a29db0752d32a54469'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.639326 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eeb8dcfb2f540a29db0752d32a54469'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.643901 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1425/2871] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:43.645814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eeb8dcfb2f540a29db0752d32a54469'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:43.665023 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1447/2872] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:43 2022] DELETE /identity/v3/users/0eeb8dcfb2f540a29db0752d32a54469 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:43.671033 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:43.672638 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:43.763728 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c3b45-9742-43c4-9065-3a6d0bdd50b3 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:43.838532 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:43.839156 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:43.839441 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:43.839786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:43.863388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:43.929115 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:43.930849 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:43.941855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1426/2873] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:44.249016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:44.250706 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:44.267662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b9c9-bfa6-4760-9c63-8311c76619a7 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:44.272446 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:44.273724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:44.274020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:44.274297 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] PATH_INFO: `/v3/projects/9988c9a5909f48dc983f9607a080c539` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:44.275501 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9988c9a5909f48dc983f9607a080c539)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:44.277907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:44.437836 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9988c9a5909f48dc983f9607a080c539', 'request_id': 'req-a12464e0-d87b-4048-8387-897892ae0c89'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.443543 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9988c9a5909f48dc983f9607a080c539', 'request_id': 'req-a12464e0-d87b-4048-8387-897892ae0c89'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.449832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9988c9a5909f48dc983f9607a080c539', 'request_id': 'req-a12464e0-d87b-4048-8387-897892ae0c89'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.526811 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] The token cache is being invalidate because project 9988c9a5909f48dc983f9607a080c539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:44.527108 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.527769 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.529913 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1448/2874] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:44 2022] DELETE /identity/v3/projects/9988c9a5909f48dc983f9607a080c539 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:44.534929 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:44.551094 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb661-fd2e-4aee-ba66-7871b3a86136 service nova] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:44.621773 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:44.622459 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:44.622740 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:44.623519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] PATH_INFO: `/v3/users/77aaca4ac60f4c88bd3efac47b0a846c` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:44.624681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77aaca4ac60f4c88bd3efac47b0a846c)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:44.626631 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:44.821947 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77aaca4ac60f4c88bd3efac47b0a846c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.955091 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77aaca4ac60f4c88bd3efac47b0a846c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.955965 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77aaca4ac60f4c88bd3efac47b0a846c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.974210 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77aaca4ac60f4c88bd3efac47b0a846c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.981848 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-19d2fc1b-c328-4747-99bb-8041342b8e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77aaca4ac60f4c88bd3efac47b0a846c'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:44.988615 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1427/2875] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:44 2022] DELETE /identity/v3/users/77aaca4ac60f4c88bd3efac47b0a846c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:45.556767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:45.558231 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:45.571772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12464e0-d87b-4048-8387-897892ae0c89 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:45.653074 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:45.653716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:45.654014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:45.655274 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] PATH_INFO: `/v3/projects/cf7e5fb27b6c4223a38b90563e2164bd` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:45.656447 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7e5fb27b6c4223a38b90563e2164bd)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:45.659345 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:45.764899 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7e5fb27b6c4223a38b90563e2164bd', 'request_id': 'req-faea7ebf-681d-42b1-ac49-73b834831fe5'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.766182 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:INSERT=2,keystone:DELETE=14,keystone:SELECT=84 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:45.771555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7e5fb27b6c4223a38b90563e2164bd', 'request_id': 'req-faea7ebf-681d-42b1-ac49-73b834831fe5'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.779818 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7e5fb27b6c4223a38b90563e2164bd', 'request_id': 'req-faea7ebf-681d-42b1-ac49-73b834831fe5'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.882493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] The token cache is being invalidate because project cf7e5fb27b6c4223a38b90563e2164bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:45.882933 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.883829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-faea7ebf-681d-42b1-ac49-73b834831fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.886212 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1449/2876] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:45 2022] DELETE /identity/v3/projects/cf7e5fb27b6c4223a38b90563e2164bd => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:45.894037 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69cc0-1495-46b5-a6bc-7e882d6f1123 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:45.894586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69cc0-1495-46b5-a6bc-7e882d6f1123 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:45.894586 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69cc0-1495-46b5-a6bc-7e882d6f1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:45.918745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-65a69cc0-1495-46b5-a6bc-7e882d6f1123 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:45.920187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-65a69cc0-1495-46b5-a6bc-7e882d6f1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:45.960590 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:45.993117 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1428/2877] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:46.003380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32d3c-91fd-40ad-9cf7-679bd5f43aac None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.003666 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32d3c-91fd-40ad-9cf7-679bd5f43aac None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.003940 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32d3c-91fd-40ad-9cf7-679bd5f43aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.027962 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-a1c32d3c-91fd-40ad-9cf7-679bd5f43aac None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:46.029952 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a1c32d3c-91fd-40ad-9cf7-679bd5f43aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:46.038275 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1450/2878] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:46.043395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69cc0-1495-46b5-a6bc-7e882d6f1123 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.053559 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69cc0-1495-46b5-a6bc-7e882d6f1123 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.059062 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.062176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.062176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.062176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] PATH_INFO: `/v3/domains` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.062176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:46.062176 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.063880 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.077472 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1429/2879] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:46.082488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32d3c-91fd-40ad-9cf7-679bd5f43aac None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.092306 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32d3c-91fd-40ad-9cf7-679bd5f43aac None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.098191 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.098799 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.099075 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.099350 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.099994 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.101951 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.214611 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1451/2880] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:46 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:46.219319 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.229626 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148e795-a8a7-4f98-af70-1ad536e0d76f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.291294 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.292230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.292862 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.293810 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.294769 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.297635 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.408657 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1430/2881] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:46 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:46.414286 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.427321 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c06568-855a-4839-8edd-21bdbe678218 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.432521 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.433300 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.433644 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.434011 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.434683 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.437031 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.448693 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1452/2882] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:37:46.454715 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.466813 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0de7a-a4aa-47c4-807f-fda8304c22d8 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.472014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f6613-8413-4632-9167-691001cb59de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.472681 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6613-8413-4632-9167-691001cb59de admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.473121 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6613-8413-4632-9167-691001cb59de admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.473498 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6613-8413-4632-9167-691001cb59de admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.474265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f6613-8413-4632-9167-691001cb59de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.476040 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f6613-8413-4632-9167-691001cb59de admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.489456 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1431/2883] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:46.494888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.507299 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4c2b4-ae2a-43b8-8cf6-64f316ed464a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.512678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.513405 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.513804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.518623 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] PATH_INFO: `/v3/projects/1664f673be12459387274b9b5babdc39/users/785a55cfaa5c47b993f20f9cdce06079/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.532984 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1664f673be12459387274b9b5babdc39, user_id=785a55cfaa5c47b993f20f9cdce06079, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.535659 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.625802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1453/2884] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:46 2022] PUT /identity/v3/projects/1664f673be12459387274b9b5babdc39/users/785a55cfaa5c47b993f20f9cdce06079/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:46.637305 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ca51-4ecc-439d-be46-e8979388be03 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.637609 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ca51-4ecc-439d-be46-e8979388be03 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.637881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ca51-4ecc-439d-be46-e8979388be03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.668685 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-4213ca51-4ecc-439d-be46-e8979388be03 None None] MFA Rules not processed for user `785a55cfaa5c47b993f20f9cdce06079`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:46.671406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-4213ca51-4ecc-439d-be46-e8979388be03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:46.749132 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1432/2885] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:46.753834 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.819292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16507-f2b3-40d0-b619-a1e859bb1b46 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.824016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.824617 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.824930 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.825337 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] PATH_INFO: `/v3/projects` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.825942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.828016 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.934241 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1454/2886] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:46 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:46.938885 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213ca51-4ecc-439d-be46-e8979388be03 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.950072 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213ca51-4ecc-439d-be46-e8979388be03 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.983925 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:47.020939 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:47.021696 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.021881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.022289 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] PATH_INFO: `/v3/users` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.022957 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:47.026919 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.166123 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1433/2887] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:46 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:47.171230 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:47.183332 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45642a-38a0-4859-9562-5c2bdac994db admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:47.189888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:47.189888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.189888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.189888 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.190363 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:47.191854 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.204415 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1455/2888] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:47.209031 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:47.220762 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d395def-655f-446f-a443-c8cacce2204f admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:47.229669 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:47.230411 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.235617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.235617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] PATH_INFO: `/v3/projects/bf03ec6999b941a7b4160a7f292d16ec/users/7718749a3f6649ae9441f263289b1cf4/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.247378 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf03ec6999b941a7b4160a7f292d16ec, user_id=7718749a3f6649ae9441f263289b1cf4, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:47.250169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.408373 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1434/2889] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:47 2022] PUT /identity/v3/projects/bf03ec6999b941a7b4160a7f292d16ec/users/7718749a3f6649ae9441f263289b1cf4/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:47.412793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:47.423973 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28332-1d6d-475a-856f-b6ca1a788a5f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:47.478070 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:47.491598 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6bfd9-a819-4021-bc9a-f8c636b9e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:47.492213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bfd9-a819-4021-bc9a-f8c636b9e862 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.492488 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bfd9-a819-4021-bc9a-f8c636b9e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.492784 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bfd9-a819-4021-bc9a-f8c636b9e862 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.493433 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6bfd9-a819-4021-bc9a-f8c636b9e862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:47.495041 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6bfd9-a819-4021-bc9a-f8c636b9e862 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.505771 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1456/2890] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:47.511349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:47.523181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc6d23-00e2-4fda-bb16-25bb3fca8e10 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:47.528141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:47.528819 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.529676 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.529958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] PATH_INFO: `/v3/projects/bf03ec6999b941a7b4160a7f292d16ec/users/7718749a3f6649ae9441f263289b1cf4/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.531915 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf03ec6999b941a7b4160a7f292d16ec, user_id=7718749a3f6649ae9441f263289b1cf4, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:47.534592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.550953 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1435/2891] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:47 2022] PUT /identity/v3/projects/bf03ec6999b941a7b4160a7f292d16ec/users/7718749a3f6649ae9441f263289b1cf4/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:47.570010 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6df9e-572f-4be4-b4d4-8d9c4d3eea84 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.570315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6df9e-572f-4be4-b4d4-8d9c4d3eea84 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.570604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6df9e-572f-4be4-b4d4-8d9c4d3eea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.611244 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-9af6df9e-572f-4be4-b4d4-8d9c4d3eea84 None None] MFA Rules not processed for user `7718749a3f6649ae9441f263289b1cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:47.611787 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-9af6df9e-572f-4be4-b4d4-8d9c4d3eea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:47.699213 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1457/2892] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:47.712805 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:47.714719 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:47.789700 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f5f1-8b40-4cc3-9124-7bf20d3432e3 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:47.793265 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234a2ac-b750-47fd-9243-d4590b925a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:47.793905 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a2ac-b750-47fd-9243-d4590b925a70 service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.794182 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a2ac-b750-47fd-9243-d4590b925a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.794450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a2ac-b750-47fd-9243-d4590b925a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.804247 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234a2ac-b750-47fd-9243-d4590b925a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:47.805749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234a2ac-b750-47fd-9243-d4590b925a70 service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.819023 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1436/2893] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:47.979335 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6df9e-572f-4be4-b4d4-8d9c4d3eea84 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.054724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6df9e-572f-4be4-b4d4-8d9c4d3eea84 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.060362 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.061382 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.061663 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.061931 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] PATH_INFO: `/v3/users/785a55cfaa5c47b993f20f9cdce06079` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.063190 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785a55cfaa5c47b993f20f9cdce06079)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.065393 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.331020 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785a55cfaa5c47b993f20f9cdce06079'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.331633 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785a55cfaa5c47b993f20f9cdce06079'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.430246 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785a55cfaa5c47b993f20f9cdce06079'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.430987 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785a55cfaa5c47b993f20f9cdce06079'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.440900 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-c6c7dc7e-2c99-4345-baeb-c3bce8b3a6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785a55cfaa5c47b993f20f9cdce06079'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.449240 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:48.454867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.454867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.454867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.462030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1458/2894] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:47 2022] DELETE /identity/v3/users/785a55cfaa5c47b993f20f9cdce06079 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:48.467014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.467298 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.467580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.472820 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:48.474086 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:48.487859 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:48.489124 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:48.545917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1437/2895] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:48.559671 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1459/2896] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:48.571734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.572112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.572453 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:48.573100 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:48.607159 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:48.636437 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbd6f3-de0d-4c6f-86b7-4b194ddc15a2 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.641720 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.642340 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.647362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.647362 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.653142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.654672 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.656234 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ce6e5-41a9-4067-987c-fc9878b118c7 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.662160 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.662750 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.663032 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.663308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.667415 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1438/2897] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:37:48.675842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.677532 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.688840 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1460/2898] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:37:49.222416 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.228295 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:49.244428 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc83f-63e0-45f7-92ac-b6a302730549 service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.251569 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.252242 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.252585 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.252967 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] PATH_INFO: `/v3/projects/1664f673be12459387274b9b5babdc39` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.254181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1664f673be12459387274b9b5babdc39)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.256151 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.410944 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1664f673be12459387274b9b5babdc39', 'request_id': 'req-cc7fffad-7fb8-4c16-801a-598061949393'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.418581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1664f673be12459387274b9b5babdc39', 'request_id': 'req-cc7fffad-7fb8-4c16-801a-598061949393'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.509801 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1664f673be12459387274b9b5babdc39', 'request_id': 'req-cc7fffad-7fb8-4c16-801a-598061949393'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.523181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] The token cache is being invalidate because project 1664f673be12459387274b9b5babdc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:49.523575 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.524280 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.526268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1439/2899] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:49 2022] DELETE /identity/v3/projects/1664f673be12459387274b9b5babdc39 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:49.531554 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.543195 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c6c7-bb9b-4914-a887-c2314bd802aa service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.618009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.618646 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.618926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.619200 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] PATH_INFO: `/v3/users/7718749a3f6649ae9441f263289b1cf4` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.620391 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7718749a3f6649ae9441f263289b1cf4)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.622383 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.641354 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:49.902592 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7718749a3f6649ae9441f263289b1cf4'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.903384 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7718749a3f6649ae9441f263289b1cf4'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.989308 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7718749a3f6649ae9441f263289b1cf4'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:49.990014 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7718749a3f6649ae9441f263289b1cf4'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.005331 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-0d7576ec-2217-479e-908a-923d7ad5225b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7718749a3f6649ae9441f263289b1cf4'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.025687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1461/2900] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:49 2022] DELETE /identity/v3/users/7718749a3f6649ae9441f263289b1cf4 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:50.492215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:50.494592 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:50.513174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fffad-7fb8-4c16-801a-598061949393 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:50.587509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:50.588149 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:50.588427 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:50.588697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] PATH_INFO: `/v3/projects/bf03ec6999b941a7b4160a7f292d16ec` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:50.590864 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf03ec6999b941a7b4160a7f292d16ec)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:50.593488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:50.719625 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf03ec6999b941a7b4160a7f292d16ec', 'request_id': 'req-195a0223-ac70-45e6-934f-864e680500a8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.727855 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf03ec6999b941a7b4160a7f292d16ec', 'request_id': 'req-195a0223-ac70-45e6-934f-864e680500a8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.729633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:50.853400 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf03ec6999b941a7b4160a7f292d16ec', 'request_id': 'req-195a0223-ac70-45e6-934f-864e680500a8'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.867029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] The token cache is being invalidate because project bf03ec6999b941a7b4160a7f292d16ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:50.867311 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.868109 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-195a0223-ac70-45e6-934f-864e680500a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.869650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1440/2901] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:50 2022] DELETE /identity/v3/projects/bf03ec6999b941a7b4160a7f292d16ec => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:50.874963 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917666-f4bb-4032-a6b1-e366e237ed90 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:50.875481 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917666-f4bb-4032-a6b1-e366e237ed90 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:50.875578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917666-f4bb-4032-a6b1-e366e237ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:50.896640 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f2917666-f4bb-4032-a6b1-e366e237ed90 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:50.900880 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f2917666-f4bb-4032-a6b1-e366e237ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:50.972051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1462/2902] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:50.979898 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e15e9-b602-4a40-87de-5cafbf2a718a None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:50.980178 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e15e9-b602-4a40-87de-5cafbf2a718a None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:50.980507 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e15e9-b602-4a40-87de-5cafbf2a718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.001208 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ed9e15e9-b602-4a40-87de-5cafbf2a718a None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:51.002432 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ed9e15e9-b602-4a40-87de-5cafbf2a718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:51.011152 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1441/2903] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:51.018541 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2917666-f4bb-4032-a6b1-e366e237ed90 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.028845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2917666-f4bb-4032-a6b1-e366e237ed90 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.034772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.035380 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.035658 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.035928 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.036582 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:51.036992 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.038803 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.055493 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1463/2904] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:51.060260 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e15e9-b602-4a40-87de-5cafbf2a718a None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.070617 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e15e9-b602-4a40-87de-5cafbf2a718a None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.077511 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.078202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.078503 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.078750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.079394 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.081349 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.239940 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1442/2905] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:51 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:51.244094 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.256147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b6ef-20e5-48e8-b05b-cfdde6ece93f admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.328536 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.329594 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.330083 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.330555 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.331686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.335585 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.453727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1464/2906] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:51 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:51.458030 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.471663 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838491e9-e954-4973-a0a9-e2567c1cbb96 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.478958 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.479814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.480230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.480619 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.481802 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.485562 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.502251 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1443/2907] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:37:51.507088 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.518956 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565dc7-6e4f-496e-8042-9cc5221b476a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.524079 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7fa0f-729f-40ba-9326-85284d8fe0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.524703 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fa0f-729f-40ba-9326-85284d8fe0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.525018 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fa0f-729f-40ba-9326-85284d8fe0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.525293 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fa0f-729f-40ba-9326-85284d8fe0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.526203 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7fa0f-729f-40ba-9326-85284d8fe0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.527845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7fa0f-729f-40ba-9326-85284d8fe0e3 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.535339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:51.541676 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1465/2908] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:51.553712 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.565379 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778f3d8-92cc-4981-85ee-16cef58ef71e admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.571954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.572666 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.582423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.582423 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] PATH_INFO: `/v3/projects/9420ee3db2ff4f758f5bcdb76cfb84d9/users/042e11d908e34f949b563f4b734be8d2/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.593639 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9420ee3db2ff4f758f5bcdb76cfb84d9, user_id=042e11d908e34f949b563f4b734be8d2, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.596385 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.705736 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1444/2909] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:51 2022] PUT /identity/v3/projects/9420ee3db2ff4f758f5bcdb76cfb84d9/users/042e11d908e34f949b563f4b734be8d2/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:51.717802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565fd5-f9ca-443c-bd9f-7967be41f676 None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.718277 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565fd5-f9ca-443c-bd9f-7967be41f676 None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.718571 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565fd5-f9ca-443c-bd9f-7967be41f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.751684 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-f5565fd5-f9ca-443c-bd9f-7967be41f676 None None] MFA Rules not processed for user `042e11d908e34f949b563f4b734be8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:51.752891 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-f5565fd5-f9ca-443c-bd9f-7967be41f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:51.835944 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1466/2910] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:51.842231 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.925014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaaa99-1e66-4b50-8134-88bcf2eb81c6 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.929909 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.930633 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.931045 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.931234 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.932015 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.934002 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.081786 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1445/2911] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:51 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:52.086118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565fd5-f9ca-443c-bd9f-7967be41f676 None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:52.100997 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565fd5-f9ca-443c-bd9f-7967be41f676 None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:52.182681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:52.183358 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.183642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.183917 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.184578 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:52.188185 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.293546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1467/2912] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:52 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:52.300519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:52.313714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a60637-bb27-4e26-bb62-82d786bbdd95 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:52.318867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:52.319502 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.325308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.325308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.325308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:52.325308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.335204 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1446/2913] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:52.339865 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:52.353920 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0344d1-1f0f-4b87-ba37-7dbd13a35db5 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:52.359745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:52.360434 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.360717 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.361030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] PATH_INFO: `/v3/projects/91203d75fe0d457bb9cf7088e24cb946/users/966fbe5e83bf4ff5b4f2babb9cc0b35b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.379642 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91203d75fe0d457bb9cf7088e24cb946, user_id=966fbe5e83bf4ff5b4f2babb9cc0b35b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:52.382526 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.516280 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1468/2914] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:52 2022] PUT /identity/v3/projects/91203d75fe0d457bb9cf7088e24cb946/users/966fbe5e83bf4ff5b4f2babb9cc0b35b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:52.520649 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:52.532509 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c45801-bbda-4138-80de-fdb6ddc5087a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:52.588954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:52.598777 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2990bb2-28e5-4d30-af4a-9bf4db6810c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:52.599397 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990bb2-28e5-4d30-af4a-9bf4db6810c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.601822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990bb2-28e5-4d30-af4a-9bf4db6810c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.601822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990bb2-28e5-4d30-af4a-9bf4db6810c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.601822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2990bb2-28e5-4d30-af4a-9bf4db6810c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:52.602169 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2990bb2-28e5-4d30-af4a-9bf4db6810c6 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.615172 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1447/2915] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:52.619593 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:52.631716 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9a02-7f54-4e3f-9da1-618986fa7e76 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:52.637782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:52.638596 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] REQUEST_METHOD: `PUT` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.639233 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.639650 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] PATH_INFO: `/v3/projects/91203d75fe0d457bb9cf7088e24cb946/users/966fbe5e83bf4ff5b4f2babb9cc0b35b/roles/b10f30fad85f46e1be0c6205b9835be6` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.649679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91203d75fe0d457bb9cf7088e24cb946, user_id=966fbe5e83bf4ff5b4f2babb9cc0b35b, role_id=b10f30fad85f46e1be0c6205b9835be6)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:52.649679 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.658162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1469/2916] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:52 2022] PUT /identity/v3/projects/91203d75fe0d457bb9cf7088e24cb946/users/966fbe5e83bf4ff5b4f2babb9cc0b35b/roles/b10f30fad85f46e1be0c6205b9835be6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:52.671436 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f98d-3f7b-43b2-b9d7-7b6a8dd24f16 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.671723 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f98d-3f7b-43b2-b9d7-7b6a8dd24f16 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.672006 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f98d-3f7b-43b2-b9d7-7b6a8dd24f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.704778 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-32a0f98d-3f7b-43b2-b9d7-7b6a8dd24f16 None None] MFA Rules not processed for user `966fbe5e83bf4ff5b4f2babb9cc0b35b`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:52.706004 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-32a0f98d-3f7b-43b2-b9d7-7b6a8dd24f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:52.783883 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1448/2917] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:52.798842 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:52.800678 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:52.855248 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:52.869205 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919759-87a8-4b8a-8ea5-c47d3021b09c admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:52.875793 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:52.876407 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.876698 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.877037 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.887147 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:52.888662 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.899652 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1470/2918] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:53.804818 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf08f-84a2-4c69-9b8a-5a3999353ac9 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.805290 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf08f-84a2-4c69-9b8a-5a3999353ac9 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.805393 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf08f-84a2-4c69-9b8a-5a3999353ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.831652 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8d7bf08f-84a2-4c69-9b8a-5a3999353ac9 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:53.832891 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8d7bf08f-84a2-4c69-9b8a-5a3999353ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:53.905908 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1449/2919] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:53.935518 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.937399 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:54.027815 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194905b-71ec-4dd9-a8fb-a906dc7fec0f service cinder] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.034727 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e622a3-2ea4-42d3-93b9-c958c8ca6ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.035339 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e622a3-2ea4-42d3-93b9-c958c8ca6ada service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.035643 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e622a3-2ea4-42d3-93b9-c958c8ca6ada service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.035915 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e622a3-2ea4-42d3-93b9-c958c8ca6ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.046901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e622a3-2ea4-42d3-93b9-c958c8ca6ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.049638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e622a3-2ea4-42d3-93b9-c958c8ca6ada service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.061086 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1471/2920] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:54.210230 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf08f-84a2-4c69-9b8a-5a3999353ac9 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.222118 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf08f-84a2-4c69-9b8a-5a3999353ac9 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.226977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.227603 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.227997 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.230950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] PATH_INFO: `/v3/users/042e11d908e34f949b563f4b734be8d2` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.230950 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=042e11d908e34f949b563f4b734be8d2)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.231363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.479678 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042e11d908e34f949b563f4b734be8d2'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:54.549910 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042e11d908e34f949b563f4b734be8d2'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:54.550637 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042e11d908e34f949b563f4b734be8d2'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:54.564010 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:54.565331 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042e11d908e34f949b563f4b734be8d2'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:54.572408 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042e11d908e34f949b563f4b734be8d2'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:54.579013 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1450/2921] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:54 2022] DELETE /identity/v3/users/042e11d908e34f949b563f4b734be8d2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:54.583724 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.584009 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.584284 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.606112 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:54.607945 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:54.671626 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1472/2922] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:54.681628 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.683093 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:54.750745 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c1322-9359-4bcb-9ac9-68d6811bb45d admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.755606 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.757089 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.757222 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.757936 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.772971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.773973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.787963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1451/2923] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:55.282545 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:55.284064 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:55.299464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8d0ae-6382-4f3a-8a37-4e74f48c0f1c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:55.304903 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:55.305544 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.305821 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.306660 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] PATH_INFO: `/v3/projects/9420ee3db2ff4f758f5bcdb76cfb84d9` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.308116 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9420ee3db2ff4f758f5bcdb76cfb84d9)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:55.310785 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:55.539866 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9420ee3db2ff4f758f5bcdb76cfb84d9', 'request_id': 'req-a13ef27a-6d49-444f-8fd4-50145fd85869'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:55.546336 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9420ee3db2ff4f758f5bcdb76cfb84d9', 'request_id': 'req-a13ef27a-6d49-444f-8fd4-50145fd85869'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:55.552710 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9420ee3db2ff4f758f5bcdb76cfb84d9', 'request_id': 'req-a13ef27a-6d49-444f-8fd4-50145fd85869'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:55.555491 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:55.692757 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] The token cache is being invalidate because project 9420ee3db2ff4f758f5bcdb76cfb84d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:55.693044 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:55.693687 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:55.695315 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1473/2924] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:55 2022] DELETE /identity/v3/projects/9420ee3db2ff4f758f5bcdb76cfb84d9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:55.699900 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:55.710238 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a147f11-9cb8-4d46-a3ba-ec57815c30fb service neutron] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:55.770363 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:55.771187 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.771481 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.771768 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] PATH_INFO: `/v3/users/966fbe5e83bf4ff5b4f2babb9cc0b35b` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.773053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966fbe5e83bf4ff5b4f2babb9cc0b35b)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:55.774973 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:55.993746 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966fbe5e83bf4ff5b4f2babb9cc0b35b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.064157 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966fbe5e83bf4ff5b4f2babb9cc0b35b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.064884 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966fbe5e83bf4ff5b4f2babb9cc0b35b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.084842 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966fbe5e83bf4ff5b4f2babb9cc0b35b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.094181 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-a456bc4b-3992-4641-ae66-145bbab19803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966fbe5e83bf4ff5b4f2babb9cc0b35b'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.102175 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1452/2925] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:55 2022] DELETE /identity/v3/users/966fbe5e83bf4ff5b4f2babb9cc0b35b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:56.591267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:56.592832 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:56.606795 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ef27a-6d49-444f-8fd4-50145fd85869 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:56.681156 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:56.681804 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:56.682267 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:56.682559 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] PATH_INFO: `/v3/projects/91203d75fe0d457bb9cf7088e24cb946` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:56.683752 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91203d75fe0d457bb9cf7088e24cb946)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:56.686372 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:56.822320 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91203d75fe0d457bb9cf7088e24cb946', 'request_id': 'req-42025d18-186d-41d4-a066-2c0b8c84ce0a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.829948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91203d75fe0d457bb9cf7088e24cb946', 'request_id': 'req-42025d18-186d-41d4-a066-2c0b8c84ce0a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.837017 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91203d75fe0d457bb9cf7088e24cb946', 'request_id': 'req-42025d18-186d-41d4-a066-2c0b8c84ce0a'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.968045 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] The token cache is being invalidate because project 91203d75fe0d457bb9cf7088e24cb946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82093) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:56.968338 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.969029 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:56.970561 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1474/2926] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:56 2022] DELETE /identity/v3/projects/91203d75fe0d457bb9cf7088e24cb946 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:58.160847 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feeb70-f76f-44fd-8530-268db4900111 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:58.161519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feeb70-f76f-44fd-8530-268db4900111 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:58.161519 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feeb70-f76f-44fd-8530-268db4900111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:58.184216 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-b8feeb70-f76f-44fd-8530-268db4900111 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:58.186308 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-b8feeb70-f76f-44fd-8530-268db4900111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:58.192963 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:58.254616 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1453/2927] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:58.279187 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:58.280670 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:58.361437 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025d18-186d-41d4-a066-2c0b8c84ce0a admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:58.367040 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:58.367645 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:58.367950 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:58.368189 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:58.377005 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:58.378589 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:58.389292 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1475/2928] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:38:08.383988 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:08.458577 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=23 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:17.264525 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd73ff2-3e8d-49d9-8fd7-f326fc325e55 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:17.265361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd73ff2-3e8d-49d9-8fd7-f326fc325e55 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:17.265361 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd73ff2-3e8d-49d9-8fd7-f326fc325e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:17.285299 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-cfd73ff2-3e8d-49d9-8fd7-f326fc325e55 None None] MFA Rules not processed for user `bac353c41ef341d5a2eba557ff9846ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:38:17.286531 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-cfd73ff2-3e8d-49d9-8fd7-f326fc325e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:17.344069 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1454/2929] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:38:17.584772 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:17.586247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:17.646807 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d60af-ef63-465d-a622-117608c63167 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:17.650517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:17.651120 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:17.651668 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:17.651942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:17.653712 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:17.664535 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:17.666081 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:17.674496 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1476/2930] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:38:27.337202 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=25 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:27.670580 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=26 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:35.377322 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeae93-6171-4cdc-952e-79155f7b5a72 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:35.377954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeae93-6171-4cdc-952e-79155f7b5a72 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:35.377954 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeae93-6171-4cdc-952e-79155f7b5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:35.398595 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-7beeae93-6171-4cdc-952e-79155f7b5a72 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:38:35.399814 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-7beeae93-6171-4cdc-952e-79155f7b5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:35.408840 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1455/2931] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:38:35.434408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:35.449157 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c702f8-a5d5-47b3-bb09-c3c9dc67e472 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:35.456272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:35.458487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:35.458487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:35.458487 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:35.466691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:35.468278 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:35.477976 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1477/2932] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:38:38.745837 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661561-2f1d-487e-a3fd-236f6f07ebec None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:38.746388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661561-2f1d-487e-a3fd-236f6f07ebec None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:38.746388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661561-2f1d-487e-a3fd-236f6f07ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:38.771826 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-68661561-2f1d-487e-a3fd-236f6f07ebec None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:38:38.773139 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-68661561-2f1d-487e-a3fd-236f6f07ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:38.782293 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1456/2933] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:38:38.808253 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:38.811906 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:38.826260 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fc1ad-1c7e-4131-8f9e-94e7f8c73653 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:38.831974 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:38.832577 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:38.832948 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:38.833232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:38.842773 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:38.844426 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:38.854753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1478/2934] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:38:42.734488 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c03bc-1e33-4fc2-ba2a-c4ead702f7dc None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:42.735017 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c03bc-1e33-4fc2-ba2a-c4ead702f7dc None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:42.735122 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c03bc-1e33-4fc2-ba2a-c4ead702f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:42.755629 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-751c03bc-1e33-4fc2-ba2a-c4ead702f7dc None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:38:42.756875 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-751c03bc-1e33-4fc2-ba2a-c4ead702f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:42.765733 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1457/2935] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:38:42.796026 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:42.808621 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed18de-0026-4ea2-af25-757b4cb613e8 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:42.814901 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:42.815507 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:42.815812 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:42.816114 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:42.825863 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:42.827531 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:42.837953 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1479/2936] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:38:45.984714 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29551a-3dd2-4b91-b9fb-3b215d0b0caa None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:45.985315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29551a-3dd2-4b91-b9fb-3b215d0b0caa None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:45.985315 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29551a-3dd2-4b91-b9fb-3b215d0b0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:46.007029 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-ee29551a-3dd2-4b91-b9fb-3b215d0b0caa None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:38:46.008345 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-ee29551a-3dd2-4b91-b9fb-3b215d0b0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:46.017302 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1458/2937] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:38:46.045389 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:46.058926 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed2f0-39a0-4f1b-aa53-74431eea0b96 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:46.065270 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:46.065682 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:46.066184 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:46.066681 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:46.076030 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:46.077686 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:46.088753 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1480/2938] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:38:51.293923 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:51.294508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:51.294508 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:51.314252 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:38:51.315462 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:51.326775 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1459/2939] 10.222.0.102 () {58 vars in 1017 bytes} [Fri Sep 2 21:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:38:51.351051 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:51.362540 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40b8ac-3347-4d0b-b6dd-22bc52210feb service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:51.368483 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a55753c439f54804814aca0a3feb96ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:51.369173 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:51.369472 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:51.369749 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:51.378558 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:51.380162 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:51.390439 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1481/2940] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:39:01.309450 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=15 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:01.386247 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=30 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:26.619921 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:26.621513 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:26.693793 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf900-fe27-4fdd-a37f-d651279aba93 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:26.698750 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:26.699348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:26.699624 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:26.699893 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:26.702268 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:26.714439 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:26.716008 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:26.727604 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1460/2941] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:39:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:39:26.748942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:26.750498 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:26.764367 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9b82a-0b45-4ea9-8c02-bb28e28da1f8 service nova] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:26.774814 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:26.780154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:26.780154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:26.780154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] PATH_INFO: `/v3/users/bac353c41ef341d5a2eba557ff9846ed` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:26.780154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac353c41ef341d5a2eba557ff9846ed)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:26.780154 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:26.968552 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac353c41ef341d5a2eba557ff9846ed'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:26.969285 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac353c41ef341d5a2eba557ff9846ed'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.085829 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac353c41ef341d5a2eba557ff9846ed'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.086506 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac353c41ef341d5a2eba557ff9846ed'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.097691 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-93c87289-aba6-46e3-934f-38c01f28c0f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac353c41ef341d5a2eba557ff9846ed'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.116841 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1482/2942] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:39:26 2022] DELETE /identity/v3/users/bac353c41ef341d5a2eba557ff9846ed => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:39:27.396084 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:27.408646 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f199cc9-692b-4163-abc1-5b72cfe8dc86 service placement] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:27.470822 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:27.471375 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:27.471658 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:27.471934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] PATH_INFO: `/v3/projects/b19e826d1ace424c90e6a716a6d0ac90` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:27.473174 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19e826d1ace424c90e6a716a6d0ac90)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:27.475134 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:27.617108 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19e826d1ace424c90e6a716a6d0ac90', 'request_id': 'req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.623934 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19e826d1ace424c90e6a716a6d0ac90', 'request_id': 'req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.702697 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19e826d1ace424c90e6a716a6d0ac90', 'request_id': 'req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.713708 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] The token cache is being invalidate because project b19e826d1ace424c90e6a716a6d0ac90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:39:27.713994 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.714655 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-b6ffb659-f88f-4d24-8c97-adcfaa08fb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:27.716141 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1461/2943] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:39:27 2022] DELETE /identity/v3/projects/b19e826d1ace424c90e6a716a6d0ac90 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:39:27.721845 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d59b-900b-458d-a55d-9872cb6dc19c None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:27.722137 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d59b-900b-458d-a55d-9872cb6dc19c None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:27.722482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d59b-900b-458d-a55d-9872cb6dc19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:27.742907 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-30d8d59b-900b-458d-a55d-9872cb6dc19c None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:39:27.744118 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-30d8d59b-900b-458d-a55d-9872cb6dc19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:27.804057 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1483/2944] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:39:27.813032 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492703e-a29e-46b9-9021-2651db2bf03d None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:27.813318 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492703e-a29e-46b9-9021-2651db2bf03d None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:27.813749 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492703e-a29e-46b9-9021-2651db2bf03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:27.834191 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-8492703e-a29e-46b9-9021-2651db2bf03d None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:39:27.835406 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-8492703e-a29e-46b9-9021-2651db2bf03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:27.844325 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1462/2945] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:39:27.848742 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8d59b-900b-458d-a55d-9872cb6dc19c None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:27.859453 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8d59b-900b-458d-a55d-9872cb6dc19c None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:27.864313 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:27.864942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:27.865232 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:27.865509 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:27.866175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82093) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:39:27.866482 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:27.868096 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:27.880615 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1484/2946] 10.222.0.71 () {58 vars in 1153 bytes} [Fri Sep 2 21:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:39:27.885245 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492703e-a29e-46b9-9021-2651db2bf03d None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:27.895142 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492703e-a29e-46b9-9021-2651db2bf03d None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:27.900005 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:27.900610 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:27.900930 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:27.901209 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:27.901858 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:27.904041 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:27.916166 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:28.036438 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1463/2947] 10.222.0.71 () {60 vars in 1153 bytes} [Fri Sep 2 21:39:27 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:39:28.040828 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:28.051754 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cde06-a31d-4d56-bd1f-36ad36ea7d76 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:28.111175 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:28.111782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:28.112065 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:28.112341 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] PATH_INFO: `/v3/users` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:28.113013 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:28.114938 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:28.122942 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:28.240027 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1485/2948] 10.222.0.71 () {60 vars in 1144 bytes} [Fri Sep 2 21:39:28 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:39:28.244232 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:28.254890 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ee0b-c3d7-4c2b-87b5-15c787dc3bfc admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:28.259565 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:28.260185 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:28.260460 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:28.260734 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] PATH_INFO: `/v3/roles` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:28.261395 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:28.262988 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:28.273990 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1464/2949] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:39:28.278802 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:28.289369 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2bfe-2fd3-48f3-9792-797c9c293839 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:28.293883 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e51f3f-0cd4-4901-b37f-309483da32eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:28.294471 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e51f3f-0cd4-4901-b37f-309483da32eb admin admin] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:28.294745 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e51f3f-0cd4-4901-b37f-309483da32eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:28.295056 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e51f3f-0cd4-4901-b37f-309483da32eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:28.295709 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e51f3f-0cd4-4901-b37f-309483da32eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:28.298078 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e51f3f-0cd4-4901-b37f-309483da32eb admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:28.309546 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1486/2950] 10.222.0.71 () {58 vars in 1122 bytes} [Fri Sep 2 21:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:39:28.313895 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:28.323881 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e4784-bae3-491f-96f7-c2f95834316a admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:28.329504 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:28.330163 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] REQUEST_METHOD: `PUT` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:28.330457 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:28.330751 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] PATH_INFO: `/v3/projects/dc1d9175ad3d45179247e1425e23536c/users/5f1907cec72045b9b491acc2742cf38f/roles/2e8ee3364fce49668856661174d3b27d` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:28.346832 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1d9175ad3d45179247e1425e23536c, user_id=5f1907cec72045b9b491acc2742cf38f, role_id=2e8ee3364fce49668856661174d3b27d)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:28.349623 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:28.434971 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1465/2951] 10.222.0.71 () {60 vars in 1483 bytes} [Fri Sep 2 21:39:28 2022] PUT /identity/v3/projects/dc1d9175ad3d45179247e1425e23536c/users/5f1907cec72045b9b491acc2742cf38f/roles/2e8ee3364fce49668856661174d3b27d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:39:28.445929 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922ef63-e912-4f14-b732-a2b2f811849e None None] REQUEST_METHOD: `POST` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:28.446221 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922ef63-e912-4f14-b732-a2b2f811849e None None] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:28.446503 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922ef63-e912-4f14-b732-a2b2f811849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:28.475922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.auth.core [None req-e922ef63-e912-4f14-b732-a2b2f811849e None None] MFA Rules not processed for user `5f1907cec72045b9b491acc2742cf38f`. Rule list: `[]` (Enabled: `True`). {{(pid=82093) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:39:28.477219 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-e922ef63-e912-4f14-b732-a2b2f811849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:28.543288 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1487/2952] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:39:28.554224 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:28.555917 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:28.614987 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0903ce-e96c-46f8-9033-b1797a0d8128 admin admin] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:28.618977 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e37c7-b688-4070-ac72-24a041715daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb8b75d3cf3b46a79706c74501dc874e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:28.619581 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e37c7-b688-4070-ac72-24a041715daa service cinder] REQUEST_METHOD: `GET` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:28.619867 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e37c7-b688-4070-ac72-24a041715daa service cinder] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:28.620138 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e37c7-b688-4070-ac72-24a041715daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:28.629567 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e37c7-b688-4070-ac72-24a041715daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:28.631053 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e37c7-b688-4070-ac72-24a041715daa service cinder] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:28.640662 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1466/2953] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:39:38.540311 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:38.635906 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:40.721464 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922ef63-e912-4f14-b732-a2b2f811849e None None] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:40.786922 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922ef63-e912-4f14-b732-a2b2f811849e None None] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:40.791430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:40.792053 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:40.792352 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:40.792638 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] PATH_INFO: `/v3/users/5f1907cec72045b9b491acc2742cf38f` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:40.793796 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1907cec72045b9b491acc2742cf38f)` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:40.795713 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:41.026837 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1907cec72045b9b491acc2742cf38f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:41.027731 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1907cec72045b9b491acc2742cf38f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:41.113786 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1907cec72045b9b491acc2742cf38f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:41.114408 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1907cec72045b9b491acc2742cf38f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:41.122272 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.notifications [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1907cec72045b9b491acc2742cf38f'} {{(pid=82093) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:41.140524 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1488/2954] 10.222.0.71 () {58 vars in 1224 bytes} [Fri Sep 2 21:39:40 2022] DELETE /identity/v3/users/5f1907cec72045b9b491acc2742cf38f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:39:41.145878 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] REQUEST_METHOD: `POST` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:41.146388 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:41.146505 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:41.166759 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.auth.core [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] MFA Rules not processed for user `b18239f8e6e4489d8c11b7502bca0733`. Rule list: `[]` (Enabled: `True`). {{(pid=82094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:39:41.167982 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:41.231521 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1467/2955] 10.222.0.71 () {58 vars in 958 bytes} [Fri Sep 2 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:39:41.241430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:41.242864 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:41.301172 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241cf71-dc8b-486a-b673-78b1816083f0 admin admin] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:41.304599 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a588483344147629a6f557a54c34c83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:41.305224 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:41.305500 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:41.305767 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:41.316517 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:41.318080 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:41.328927 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1489/2956] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:39:42.081364 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] Authenticating user token {{(pid=82094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:39:42.082888 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.fernet_utils [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:39:42.096967 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5154-9302-4b0b-ad9f-f64ae02468c2 None None] Validating token access rules against request {{(pid=82094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:39:42.101892 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18239f8e6e4489d8c11b7502bca0733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed07aa8a11c5411cab1c62d6e9841ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:39:42.102665 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:39:42.102943 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:39:42.103215 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] PATH_INFO: `/v3/projects/dc1d9175ad3d45179247e1425e23536c` {{(pid=82094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:39:42.104352 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1d9175ad3d45179247e1425e23536c)` {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:39:42.107063 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] RBAC: Authorization granted {{(pid=82094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:39:42.280314 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1d9175ad3d45179247e1425e23536c', 'request_id': 'req-6f88bb3d-41d3-48b0-a507-8716bf437852'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:42.287650 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1d9175ad3d45179247e1425e23536c', 'request_id': 'req-6f88bb3d-41d3-48b0-a507-8716bf437852'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:42.359348 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1d9175ad3d45179247e1425e23536c', 'request_id': 'req-6f88bb3d-41d3-48b0-a507-8716bf437852'} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:42.370588 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] The token cache is being invalidate because project dc1d9175ad3d45179247e1425e23536c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:39:42.370873 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:42.371591 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG keystone.notifications [None req-6f88bb3d-41d3-48b0-a507-8716bf437852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:39:42.373014 dv-cinder-852209-11-smb devstack@keystone.service[82094]: [pid: 82094|app: 0|req: 1468/2957] 10.222.0.71 () {58 vars in 1233 bytes} [Fri Sep 2 21:39:42 2022] DELETE /identity/v3/projects/dc1d9175ad3d45179247e1425e23536c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:39:51.323782 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:39:52.367553 dv-cinder-852209-11-smb devstack@keystone.service[82094]: DEBUG dbcounter [-] [82094] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:40:12.020430 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] Authenticating user token {{(pid=82093) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:40:12.022605 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:40:12.090924 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d31c2-09b8-4a10-9401-829c0058cfe7 service neutron] Validating token access rules against request {{(pid=82093) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:40:12.151456 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf55f8b-1f64-405a-a236-b7a8cb5e679e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f84705571649b2bc20ec777e1e6a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad5e20a1004915a5f124122a9ea638', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82093) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:40:12.152071 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55f8b-1f64-405a-a236-b7a8cb5e679e service placement] REQUEST_METHOD: `GET` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:40:12.152353 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55f8b-1f64-405a-a236-b7a8cb5e679e service placement] SCRIPT_NAME: `/identity` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:40:12.153095 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55f8b-1f64-405a-a236-b7a8cb5e679e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82093) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:40:12.154798 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.fernet_utils [None req-adf55f8b-1f64-405a-a236-b7a8cb5e679e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82093) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:40:12.166991 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf55f8b-1f64-405a-a236-b7a8cb5e679e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:40:12.168604 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf55f8b-1f64-405a-a236-b7a8cb5e679e service placement] RBAC: Authorization granted {{(pid=82093) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:40:12.179495 dv-cinder-852209-11-smb devstack@keystone.service[82093]: [pid: 82093|app: 0|req: 1490/2958] 10.222.0.71 () {60 vars in 1365 bytes} [Fri Sep 2 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:40:22.174465 dv-cinder-852209-11-smb devstack@keystone.service[82093]: DEBUG dbcounter [-] [82093] Writing DB stats keystone:SELECT=58 {{(pid=82093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}